00010000:00010000:1.0F:1717018875.404045:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1717018876.216188:0:27068:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1717018876.216196:0:27068:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1717018876.216199:0:27068:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1717018876.216676:0:27068:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1717018876.216683:0:27068:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1717018876.216713:0:27068:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_22c.lustre-OST0000_UUID fl=4 20000000:01000000:3.0F:1717018876.217884:0:27069:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 86 marker 59 1->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0000_UUID 20000000:01000000:3.0:1717018876.217973:0:27069:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 88 marker 59 2->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:3.0:1717018876.218024:0:27069:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 93 count 91 00000040:00080000:1.0:1717018876.218292:0:27068:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].93, 224 off25392 20000000:01000000:1.0:1717018876.218302:0:27068:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_22c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1717018876.218335:0:27068:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].94, 144 off25536 00000040:00080000:1.0:1717018876.218399:0:27068:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].95, 224 off25760 20000000:01000000:1.0:1717018876.218698:0:27068:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_22c.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1717018876.219443:0:27070:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 92 marker 60 1->4: lustre-clilov add lustre.test_22c.lustre-OST0000_UUID 20000000:01000000:3.0:1717018876.219506:0:27070:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 94 marker 60 2->4: lustre-clilov add lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:3.0:1717018876.219551:0:27070:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 98 count 96 00000040:00080000:1.0:1717018876.219857:0:27068:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].98, 224 off26192 20000000:01000000:1.0:1717018876.219867:0:27068:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce022 lustre test_22c lustre-OST0000_UUID (null) 00000040:00080000:1.0:1717018876.219905:0:27068:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].99, 136 off26328 00000040:00080000:1.0:1717018876.219940:0:27068:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].100, 224 off26552 10000000:01000000:1.0:1717018876.219950:0:27068:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1717018876.219964:0:27068:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.219977:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c16da expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.219983:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.219987:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.219991:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1704 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.219995:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1712 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220008:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1720 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220013:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c172e expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220019:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220024:0:27068:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220029:0:27068:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220057:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220068:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 8 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220079:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539ed40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819889856:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717018876.220144:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220150:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 8 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220156:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819889920:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717018876.220176:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c172e expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220186:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c172e expref: 17 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220192:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013289d0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819889984:0@lo:104: 00000100:00100000:1.0:1717018876.220218:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717018876.220245:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1720 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220250:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1720 expref: 17 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220256:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007deec740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890048:0@lo:104: 00000100:00100000:3.0:1717018876.220265:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819889984 00000100:00100000:1.0:1717018876.220268:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717018876.220290:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1712 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018876.220292:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890048 00010000:00010000:1.0:1717018876.220295:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1712 expref: 17 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220301:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007dee97c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890112:0@lo:104: 00000100:00100000:3.0:1717018876.220305:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1717018876.220308:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801328984c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819889984:12345-0@lo:104: 00000100:00100000:1.0:1717018876.220315:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717018876.220324:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1704 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220329:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1704 expref: 17 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220334:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008129aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890176:0@lo:104: 00010000:00010000:3.0:1717018876.220352:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018876.220355:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801328984c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819889984:12345-0@lo:104: Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018876.220361:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1717018876.220374:0:6614:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0F:1717018876.220415:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890112 00000100:00100000:0.0:1717018876.220431:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1717018876.220434:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007deed580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819890048:12345-0@lo:104: 00000100:00100000:3.0:1717018876.220470:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1717018876.220472:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008fb7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819890112:12345-0@lo:104: 00000100:00100000:1.0:1717018876.220488:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018876.220501:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1717018876.220504:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007deed580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819890048:12345-0@lo:104: Request processed in 70us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1717018876.220506:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1717018876.220508:0:6619:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1717018876.220508:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1717018876.220509:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008fb7d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819890112:12345-0@lo:104: Request processed in 36us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018876.220512:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00010000:00010000:1.0:1717018876.220516:0:6619:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.220517:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890176 00010000:00010000:1.0:1717018876.220522:0:6619:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1f80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:1.0:1717018876.220524:0:6619:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.220524:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1717018876.220527:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800812984c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:27068:x1800422819890176:12345-0@lo:104: 00010000:00010000:1.0:1717018876.220529:0:6619:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018876.220534:0:6619:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018876.220537:0:6619:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018876.220545:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1717018876.220546:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:0.0:1717018876.220548:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800812984c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:27068:x1800422819890176:12345-0@lo:104: Request processed in 21us (60us total) trans 0 rc 0/0 00010000:00010000:3.0:1717018876.220549:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.220551:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00010000:00010000:3.0:1717018876.220554:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79cfc0 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018876.220556:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220557:0:6619:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220561:0:6619:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018876.220561:0:12712:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717018876.220564:0:12712:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.220568:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.220568:0:12712:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79d680 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018876.220570:0:12712:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018876.220572:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220572:0:6619:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.220573:0:12712:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018876.220576:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018876.220576:0:6619:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c172e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1735 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018876.220577:0:12712:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018876.220580:0:12712:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018876.220585:0:6619:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018876.220586:0:6619:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.220587:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.220587:0:12712:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220590:0:6619:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79df80 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:3.0:1717018876.220591:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1717018876.220591:0:6619:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.220594:0:12712:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018876.220595:0:6619:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.220599:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.220599:0:12712:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.220603:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79cfc0/0x81e56358f42c1720 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1727 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018876.220603:0:6619:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.220603:0:12712:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79d680/0x81e56358f42c1712 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1719 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018876.220606:0:6619:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018876.220610:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018876.220610:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018876.220610:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018876.220611:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018876.220612:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018876.220612:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018876.220615:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018876.220615:0:6619:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.220618:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23576c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819890368:0@lo:103:ldlm_bl_06.0 00000100:00100000:3.0:1717018876.220620:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819890304:0@lo:103:ldlm_bl_03.0 00010000:00010000:1.0:1717018876.220620:0:6619:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018876.220623:0:6619:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220627:0:6619:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c1704 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c170b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220633:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018876.220634:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018876.220635:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018876.220636:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018876.220642:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132b050c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819890240:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018876.220652:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018876.220661:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018876.220671:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890368 00000100:00100000:0.0:1717018876.220671:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890304 00000100:00100000:1.0:1717018876.220673:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1717018876.220676:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132b06d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819890432:0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1717018876.220680:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1712 expref: 19 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:0.0:1717018876.220680:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1720 expref: 19 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220689:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018876.220696:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890240 00000100:00100000:0.0:1717018876.220696:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890432 00010000:00010000:3.0:1717018876.220700:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c172e expref: 21 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:0.0:1717018876.220700:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1704 expref: 21 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:2.0F:1717018876.220708:0:6617:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75348 00000100:00100000:1.0:1717018876.220716:0:6618:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75349 00000100:00100000:2.0:1717018876.220717:0:6617:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2355580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+21:2853:x1800422819890368:12345-0@lo:103:ldlm_bl_06.0 00000100:00100000:1.0:1717018876.220720:0:6618:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086968e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+21:2852:x1800422819890304:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1717018876.220720:0:10306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75350 00000100:00100000:0.0:1717018876.220723:0:10306:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+21:2855:x1800422819890432:12345-0@lo:103:ldlm_bl_01.0 00000100:00100000:3.0:1717018876.220724:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75351 00010000:00010000:2.0:1717018876.220725:0:6617:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018876.220726:0:6618:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1717018876.220727:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+21:2855:x1800422819890240:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:0.0:1717018876.220728:0:10306:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018876.220729:0:6617:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1712 expref: 21 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:1.0:1717018876.220729:0:6618:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1720 expref: 21 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:3.0:1717018876.220730:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018876.220730:0:10306:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1704 expref: 21 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:3.0:1717018876.220732:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c172e expref: 21 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:1.0:1717018876.220736:0:6618:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1720 expref: 21 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.220876:0:6617:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1712 expref: 21 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.220888:0:6617:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717018876.220889:0:6618:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018876.220913:0:6617:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2355580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+21:2853:x1800422819890368:12345-0@lo:103:ldlm_bl_06.0 Request processed in 197us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018876.220914:0:6618:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086968e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+21:2852:x1800422819890304:12345-0@lo:103:ldlm_bl_03.0 Request processed in 193us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018876.220918:0:6617:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75348 00000100:00100000:1.0:1717018876.220921:0:6618:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75349 00010000:00010000:1.0:1717018876.220939:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 19 pid: 8249 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018876.220942:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23576c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819890368:0@lo:103:ldlm_bl_06.0 00010000:00010000:1.0:1717018876.220945:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 19 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220951:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b829c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890496:0@lo:104: 00000100:00100000:1.0:1717018876.220964:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717018876.220976:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 19 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.220981:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 19 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.220986:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82f6c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890560:0@lo:104: 00000100:00100000:1.0:1717018876.220997:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018876.221011:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890496 00000100:00100000:1.0:1717018876.221039:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890560 00000100:00100000:1.0:1717018876.221051:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1717018876.221054:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b8297c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819890496:12345-0@lo:104: 00010000:00010000:1.0:1717018876.221075:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1717018876.221077:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b8297c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:27068:x1800422819890496:12345-0@lo:104: Request processed in 24us (113us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018876.221082:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1717018876.221097:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1717018876.221099:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:27068:x1800422819890560:12345-0@lo:104: 00010000:00010000:1.0:1717018876.221118:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1717018876.221121:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:27068:x1800422819890560:12345-0@lo:104: Request processed in 21us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018876.221125:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00010000:00010000:1.0:1717018876.221136:0:6620:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1717018876.221138:0:6620:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.221142:0:6620:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e3840 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:1.0:1717018876.221144:0:6620:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.221148:0:6620:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.221199:0:10306:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1704 expref: 19 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:2.0:1717018876.221205:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819890304:0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1717018876.221208:0:10306:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717018876.221222:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018876.221225:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.221230:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e3cc0 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018876.221231:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.221233:0:10306:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+19:2855:x1800422819890432:12345-0@lo:103:ldlm_bl_01.0 Request processed in 510us (543us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018876.221235:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.221238:0:10306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75350 10000000:00010000:2.0:1717018876.221239:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018876.221243:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018876.221260:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.221265:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018876.221277:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.221281:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e3cc0/0x81e56358f42c16e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16ef expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018876.221288:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018876.221289:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018876.221290:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018876.221293:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1717018876.221298:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819890624:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018876.221315:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018876.221345:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132b06d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819890432:0@lo:103:ldlm_bl_01.0 10000000:00010000:1.0:1717018876.221380:0:6620:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018876.221384:0:6620:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018876.221387:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c172e expref: 18 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:1.0:1717018876.221395:0:6620:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.221396:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717018876.221398:0:6620:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1717018876.221398:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890624 00010000:00010000:1.0:1717018876.221403:0:6620:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.221406:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 19 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:1.0:1717018876.221407:0:6620:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c16f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16fd expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.221413:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018876.221417:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dd7850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+19:2855:x1800422819890240:12345-0@lo:103:ldlm_bl_01.0 Request processed in 689us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018876.221417:0:10306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75352 00010000:00010000:1.0:1717018876.221418:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018876.221419:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018876.221420:0:10306:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+19:2854:x1800422819890624:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018876.221421:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75351 00010000:00010000:0.0:1717018876.221425:0:10306:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018876.221427:0:10306:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 18 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:1.0:1717018876.221428:0:27068:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c16da expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.221434:0:27068:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c16da expref: 18 pid: 8250 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.221440:0:27068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890752:0@lo:104: 00010000:00010000:0.0:1717018876.221442:0:10306:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 18 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:0.0:1717018876.221448:0:10306:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1717018876.221456:0:27068:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018876.221464:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132b050c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819890240:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018876.221464:0:10306:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819890624:12345-0@lo:103:ldlm_bl_05.0 Request processed in 43us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018876.221467:0:27068:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093f716c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018876.221468:0:10306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75352 00010000:00010000:1.0:1717018876.221483:0:27068:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1f80/0x81e56358f42c1735 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c172e expref: 17 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.221490:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013289d0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819889984:0@lo:104: 00000100:00100000:0.0:1717018876.221492:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890752 00010000:00010000:1.0:1717018876.221495:0:27068:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1d40/0x81e56358f42c1727 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1720 expref: 16 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:0.0:1717018876.221503:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1717018876.221506:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+3:27068:x1800422819890752:12345-0@lo:104: 00010000:00010000:0.0:1717018876.221526:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1717018876.221529:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+3:27068:x1800422819890752:12345-0@lo:104: Request processed in 22us (72us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018876.221533:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1717018876.221560:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007deec740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890048:0@lo:104: 00010000:00010000:1.0:1717018876.221568:0:27068:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1719 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1712 expref: 15 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:2.0:1717018876.221594:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1717018876.221598:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819890624:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018876.221600:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819890688:0@lo:103:ldlm_bl_02.0 00010000:00010000:0.0:1717018876.221608:0:12712:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018876.221615:0:12712:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018876.221617:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018876.221619:0:12712:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2d00 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018876.221621:0:12712:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.221625:0:12712:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018876.221629:0:12712:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018876.221632:0:12712:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018876.221645:0:12712:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.221649:0:12712:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1717018876.221664:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819890816:0@lo:103:ldlm_bl_06.0 00010000:00010000:0.0:1717018876.221671:0:12712:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018876.221675:0:12712:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c16da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c16e1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018876.221677:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018876.221684:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018876.221685:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018876.221686:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018876.221693:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890688 00000100:00100000:2.0:1717018876.221694:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890816 00010000:00010000:2.0:1717018876.221702:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c16da expref: 16 pid: 8250 timeout: 2009 lvb_type: 0 00010000:00010000:0.0:1717018876.221702:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 16 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:0.0:1717018876.221713:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75353 00000100:00100000:2.0:1717018876.221716:0:10306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75354 00000100:00100000:0.0:1717018876.221716:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+16:2853:x1800422819890688:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:2.0:1717018876.221719:0:10306:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+16:2853:x1800422819890816:12345-0@lo:103:ldlm_bl_06.0 00010000:00010000:2.0:1717018876.221724:0:10306:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018876.221725:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018876.221728:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 16 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.221730:0:10306:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c16da expref: 16 pid: 8250 timeout: 2009 lvb_type: 0 00010000:00010000:0.0:1717018876.221733:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 16 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.221753:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007dee97c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890112:0@lo:104: 00010000:00010000:1.0:1717018876.221766:0:27068:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1200/0x81e56358f42c170b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1704 expref: 16 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.221772:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008129aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890176:0@lo:104: 00000100:00100000:1.0:1717018876.221776:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b829c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890496:0@lo:104: 00010000:00010000:1.0:1717018876.221780:0:27068:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88013304bcc0/0x81e56358f42c16ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c16e8 expref: 15 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:1.0:1717018876.221793:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82f6c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890560:0@lo:104: 00000100:00100000:1.0:1717018876.221798:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819890752:0@lo:104: 00010000:00010000:2.0:1717018876.221844:0:10306:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c16da expref: 14 pid: 8250 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.221852:0:10306:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79e880/0x81e56358f42c16e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c16da expref: 14 pid: 8250 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.221858:0:10306:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018876.221882:0:10306:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+13:2853:x1800422819890816:12345-0@lo:103:ldlm_bl_06.0 Request processed in 163us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018876.221887:0:10306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75354 00000100:00100000:3.0:1717018876.221987:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819890816:0@lo:103:ldlm_bl_06.0 00010000:00010000:0.0:1717018876.222100:0:10751:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c16fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c16f6 expref: 12 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:0.0:1717018876.222108:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1717018876.222126:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+11:2853:x1800422819890688:12345-0@lo:103:ldlm_bl_02.0 Request processed in 410us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018876.222131:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75353 00000100:00100000:3.0:1717018876.222568:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819890688:0@lo:103:ldlm_bl_02.0 00000100:00100000:0.0:1717018876.223105:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018876.223318:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539ed40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819889856:192.168.203.26@tcp:104: 00000100:00100000:1.0:1717018876.223327:0:27068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27068:1800422819889920:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717018876.223387:0:27068:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018876.223594:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018876.223677:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667392 00010000:00010000:2.0:1717018876.223699:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 9 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:2.0:1717018876.223739:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667456 00010000:00010000:2.0:1717018876.223748:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 10 pid: 8248 timeout: 2009 lvb_type: 0 00000100:00100000:2.0:1717018876.223761:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75355 00000100:00100000:2.0:1717018876.223766:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a23576c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:461e9689-0dac-4669-87c3-00abdddc539f+10:1835:x1800422838667392:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018876.223773:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1717018876.223774:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75356 00010000:00010000:2.0:1717018876.223776:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 10 pid: 8249 timeout: 2009 lvb_type: 0 00000100:00100000:3.0:1717018876.223781:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:461e9689-0dac-4669-87c3-00abdddc539f+10:1836:x1800422838667456:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018876.223782:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 10 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.223791:0:10751:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880133049f80/0x81e56358f42c1743 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36738 expref: 10 pid: 8249 timeout: 2009 lvb_type: 0 00010000:00010000:3.0:1717018876.223792:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018876.223798:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 10 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:3.0:1717018876.223807:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 9 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:2.0:1717018876.223977:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1717018876.223984:0:14966:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d2ac0/0x81e56358f42c173c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36731 expref: 9 pid: 8248 timeout: 2009 lvb_type: 0 00010000:00010000:3.0:1717018876.223995:0:14966:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.223999:0:14966:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.224011:0:14966:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.224014:0:14966:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018876.224014:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a23576c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:461e9689-0dac-4669-87c3-00abdddc539f+8:1835:x1800422838667392:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 Request processed in 248us (914us total) trans 0 rc 0/0 00010000:00010000:3.0:1717018876.224017:0:14966:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.224020:0:14966:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018876.224021:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75355 00010000:00010000:3.0:1717018876.224023:0:14966:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79dd40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1717018876.224026:0:14966:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.224029:0:14966:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.224042:0:14966:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.224050:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018876.224074:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2350000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:461e9689-0dac-4669-87c3-00abdddc539f+7:1836:x1800422838667456:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 Request processed in 295us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018876.224084:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75356 00010000:00010000:1.0:1717018876.224302:0:27068:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.224308:0:27068:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018876.224312:0:27068:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79dd40/0x81e56358f42c17ac lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27068 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018876.406241:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1717018876.744072:0:8305:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902030 is committed 00010000:00010000:3.0:1717018877.409344:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018877.548590:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1717018877.548615:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819890880:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1717018877.548682:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.548758:0:13505:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890880 00000100:00100000:3.0:1717018877.548871:0:13505:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 597 00000100:00100000:3.0:1717018877.548876:0:13505:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819890880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1717018877.548910:0:13505:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1717018877.548952:0:13505:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731a600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819890880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.548958:0:13505:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 597 00000100:00100000:2.0:1717018877.549081:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819890880:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717018877.563698:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018877.564206:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667520 00000100:00100000:2.0:1717018877.564301:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 969 00000100:00100000:2.0:1717018877.564306:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+7:4633:x1800422838667520:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.564318:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018877.564332:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3675b expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.564353:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.564360:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.564366:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0fc0, rc 0) 00000100:00100000:2.0:1717018877.564562:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838667520:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 255us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018877.564568:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 969 00000100:00100000:2.0:1717018877.567759:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018877.568002:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667584 00000100:00100000:0.0:1717018877.568211:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 970 00000100:00100000:0.0:1717018877.568216:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838667584:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.568334:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838667584:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 118us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.568340:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 970 00000100:00100000:0.0:1717018877.569599:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018877.569641:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667648 00000100:00100000:1.0:1717018877.569670:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 971 00000100:00100000:1.0:1717018877.569674:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838667648:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018877.569853:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838667648:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 177us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.569858:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 971 00000100:00100000:0.0:1717018877.571678:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018877.571778:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667712 00000100:00100000:1.0:1717018877.571801:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 972 00000100:00100000:1.0:1717018877.571805:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:22715:x1800422838667712:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018877.572178:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:22715:x1800422838667712:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 372us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.572188:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 972 00000100:00100000:0.0:1717018877.573444:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018877.573539:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667776 00000100:00100000:1.0:1717018877.574042:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 973 00000100:00100000:1.0:1717018877.574047:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:22715:x1800422838667776:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:1.0:1717018877.574407:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:22715:x1800422838667776:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 359us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.574413:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 973 00000100:00100000:0.0:1717018877.576554:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018877.576626:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667840 00000100:00100000:1.0:1717018877.576667:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 974 00000100:00100000:1.0:1717018877.576672:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838667840:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018877.576682:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018877.576697:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36762 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018877.576719:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 9 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018877.576725:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 9 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018877.576731:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79e880, rc 0) 00000100:00100000:1.0:1717018877.576777:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838667840:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 104us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.576782:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 974 00000100:00100000:2.0:1717018877.578923:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018877.578967:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667904 00000100:00100000:0.0:1717018877.579009:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 975 00000100:00100000:0.0:1717018877.579014:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838667904:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.579268:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838667904:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 253us (349us total) trans 0 rc -2/-2 00000100:00100000:0.0:1717018877.579275:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 975 10000000:01000000:2.0:1717018877.756491:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018877.756497:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 98 10000000:01000000:2.0:1717018877.756501:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018877.756532:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.756540:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.756549:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.756567:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819890944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.756619:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.756653:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.756757:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819890944 00000100:00100000:0.0:1717018877.756802:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 976 00000100:00100000:0.0:1717018877.756807:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819890944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018877.756816:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018877.756846:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c17c1 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.756862:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 12 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.756869:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 12 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.756875:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1200, rc 0) 00000100:00100000:0.0:1717018877.757052:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819890944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.757058:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 976 00000100:00100000:2.0:1717018877.757118:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819890944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.757127:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.757132:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.757169:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.757185:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.757202:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.757423:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891008 00000100:00100000:0.0:1717018877.757443:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 977 00000100:00100000:0.0:1717018877.757446:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819891008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.757928:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819891008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.757944:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 977 00000100:00100000:2.0:1717018877.758006:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.758027:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.758110:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.758155:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.758208:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891072 00000100:00100000:0.0:1717018877.758344:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 978 00000100:00100000:0.0:1717018877.758348:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819891072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.758498:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819891072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.758503:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 978 00000100:00100000:2.0:1717018877.758632:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.758896:0:27092:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27092:1800422819891136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.758927:0:27092:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.758952:0:27092:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:1.0:1717018877.758961:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891136 00000100:00100000:1.0:1717018877.758982:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 979 00000100:00100000:1.0:1717018877.758991:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27092:x1800422819891136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018877.759531:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27092:x1800422819891136:12345-0@lo:502:llog_process_th.0 Request processed in 539us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.759537:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 979 00000100:00100000:3.0:1717018877.759589:0:27092:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27092:1800422819891136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.759622:0:27092:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27092:1800422819891200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.759646:0:27092:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.759667:0:27092:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:1.0:1717018877.759713:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891200 00000100:00100000:1.0:1717018877.760285:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 980 00000100:00100000:1.0:1717018877.760288:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27092:x1800422819891200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018877.760481:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27092:x1800422819891200:12345-0@lo:502:llog_process_th.0 Request processed in 191us (833us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.760486:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 980 00000100:00100000:3.0:1717018877.760544:0:27092:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27092:1800422819891200:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018877.760563:0:27092:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 101 count 99 00000020:01000000:2.0:1717018877.761223:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 98-100 (rc=0) 10000000:01000000:2.0:1717018877.761245:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018877.761250:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.761259:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018877.761266:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1717018877.761268:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 93 10000000:01000000:2.0:1717018877.761270:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1717018877.761288:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.761293:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.761300:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.761312:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.761335:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.761475:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.761555:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891264 00000100:00100000:0.0:1717018877.761586:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 981 00000100:00100000:0.0:1717018877.761590:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819891264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018877.761596:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018877.761606:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c17cf expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.761621:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c17cf expref: 13 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.761628:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17cf expref: 13 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.761633:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1d40, rc 0) 00000100:00100000:0.0:1717018877.761653:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819891264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 62us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.761658:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 981 00000100:00100000:2.0:1717018877.761755:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.761764:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.761770:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.761805:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.761822:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.761930:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:1.0:1717018877.761990:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891328 00000100:00100000:1.0:1717018877.762014:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1717018877.762017:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819891328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018877.762097:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819891328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018877.762102:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:2.0:1717018877.762205:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.762223:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.762248:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.762267:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.762305:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891392 00000100:00100000:0.0:1717018877.762317:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1717018877.762320:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819891392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.762672:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819891392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 351us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.762677:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:2.0:1717018877.762743:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.763171:0:27093:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27093:1800422819891456:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.763197:0:27093:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.763287:0:27093:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.763330:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891456 00000100:00100000:0.0:1717018877.763405:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1717018877.763408:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:27093:x1800422819891456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018877.763696:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:27093:x1800422819891456:12345-0@lo:502:llog_process_th.0 Request processed in 286us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.763701:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:3.0:1717018877.763769:0:27093:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27093:1800422819891456:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717018877.763796:0:27093:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717018877.763801:0:27093:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018877.763803:0:27093:0:(obd_config.c:1460:class_process_config()) marker 63 (0x1) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0000_UUID 00000020:00000080:3.0:1717018877.763807:0:27093:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1717018877.763818:0:27093:0:(lod_pool.c:669:lod_pool_remove()) lustre-OST0000_UUID removed from test_22c 00000100:00100000:3.0:1717018877.764484:0:27093:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27093:1800422819891520:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.764512:0:27093:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1717018877.764583:0:27094:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff880090828000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1717018877.764586:0:27094:0:(obd_mount.c:668:lustre_put_lsi()) put ffff880090828000 4 00000100:00100000:3.0:1717018877.764596:0:27093:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.764862:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891520 00000100:00100000:0.0:1717018877.764888:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:0.0:1717018877.764892:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27093:x1800422819891520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018877.765107:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27093:x1800422819891520:12345-0@lo:502:llog_process_th.0 Request processed in 214us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.765112:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:3.0:1717018877.765180:0:27093:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27093:1800422819891520:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717018877.765201:0:27093:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1717018877.765203:0:27093:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018877.765204:0:27093:0:(obd_config.c:1460:class_process_config()) marker 63 (0x2) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:3.0:1717018877.765206:0:27093:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 96 count 94 00000020:01000000:2.0:1717018877.765463:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 93-95 (rc=0) 10000000:01000000:2.0:1717018877.765509:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1717018877.765514:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.765522:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018877.765529:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018877.765530:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 98 10000000:01000000:2.0:1717018877.765532:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018877.765548:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.765552:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.765558:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.765576:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.765597:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.765617:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.765655:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891584 00000100:00100000:0.0:1717018877.765668:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:0.0:1717018877.765671:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819891584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018877.765676:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018877.765684:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c17dd expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.765696:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c17dd expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.765702:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17dd expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.765711:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1f80, rc 0) 00000100:00100000:0.0:1717018877.765978:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819891584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 306us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.765979:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.765984:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00010000:00010000:3.0:1717018877.765987:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.765993:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018877.766020:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.766035:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.766047:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.766048:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891648 00000100:00100000:0.0:1717018877.766068:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1717018877.766071:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819891648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.766140:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819891648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 68us (104us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.766145:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:3.0:1717018877.766311:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.766329:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.766353:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.766612:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.766740:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891712 00000100:00100000:2.0:1717018877.766761:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1717018877.766764:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819891712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.766923:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819891712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018877.766928:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:3.0:1717018877.767018:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.767272:0:27095:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27095:1800422819891776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.767298:0:27095:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.767307:0:27095:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.767367:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891776 00000100:00100000:0.0:1717018877.767382:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1717018877.767385:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:27095:x1800422819891776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018877.767683:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:27095:x1800422819891776:12345-0@lo:502:llog_process_th.0 Request processed in 297us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.767688:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1717018877.767846:0:27095:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27095:1800422819891776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.767877:0:27095:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27095:1800422819891840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.767899:0:27095:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.767908:0:27095:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155300 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.768059:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891840 00000100:00100000:0.0:1717018877.768614:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:0.0:1717018877.768618:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27095:x1800422819891840:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018877.768765:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27095:x1800422819891840:12345-0@lo:502:llog_process_th.0 Request processed in 146us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.768770:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:3.0:1717018877.768852:0:27095:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27095:1800422819891840:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018877.768871:0:27095:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 101 count 99 00000020:01000000:0.0:1717018877.768971:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 98-100 (rc=0) 10000000:01000000:0.0:1717018877.768992:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018877.769001:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.769009:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018877.769014:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1717018877.769016:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1717018877.769019:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1717018877.769033:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.769038:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.769044:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018877.769054:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.769076:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018877.769099:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092a11180 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.769144:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891904 00000100:00100000:2.0:1717018877.769166:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1717018877.769170:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819891904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.769176:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018877.769185:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c17eb expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.769291:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c17eb expref: 15 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.769297:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17eb expref: 15 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.769303:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d3180, rc 0) 00000100:00100000:2.0:1717018877.769336:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819891904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018877.769341:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1717018877.769395:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018877.769403:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.769409:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018877.769437:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.769456:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018877.769482:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092a11180 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.769527:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819891968 00000100:00100000:2.0:1717018877.769544:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1717018877.769547:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819891968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.769663:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819891968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018877.769669:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:1.0:1717018877.769763:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819891968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018877.769786:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018877.769810:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018877.769818:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008bed6cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.769882:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892032 00000100:00100000:0.0:1717018877.769904:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1717018877.769907:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819892032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.770131:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819892032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 223us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.770138:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:1.0:1717018877.770158:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892032:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1717018877.770764:0:27096:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1717018877.770902:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1717018877.770915:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1717018877.770918:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.770924:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018877.770930:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018877.770931:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 98 10000000:01000000:2.0:1717018877.770932:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018877.770944:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.770948:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.770953:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.770961:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.770980:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.771051:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.771087:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892096 00000100:00100000:0.0:1717018877.771107:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1717018877.771110:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819892096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018877.771115:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018877.771123:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c17f9 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.771135:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.771141:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018877.771145:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e2400, rc 0) 00000100:00100000:0.0:1717018877.771163:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819892096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 52us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.771167:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1717018877.771214:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.771221:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.771231:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.771260:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.771277:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.771284:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.771332:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892160 00000100:00100000:0.0:1717018877.771352:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:0.0:1717018877.771355:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819892160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018877.771411:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819892160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.771419:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1717018877.771485:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.771504:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.771530:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.771537:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6a80 going to sleep for 6 seconds 00000100:00100000:3.0:1717018877.771605:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892224 00000100:00100000:3.0:1717018877.771620:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:3.0:1717018877.771624:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819892224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.771764:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819892224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 140us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.771770:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1717018877.771787:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.772295:0:27097:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27097:1800422819892288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.772320:0:27097:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.772624:0:27097:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155240 going to sleep for 6 seconds 00000100:00100000:0.0:1717018877.772712:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892288 00000100:00100000:0.0:1717018877.772739:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1717018877.772742:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:27097:x1800422819892288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018877.773094:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:27097:x1800422819892288:12345-0@lo:502:llog_process_th.0 Request processed in 351us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.773100:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:3.0:1717018877.773214:0:27097:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27097:1800422819892288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.773249:0:27097:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27097:1800422819892352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018877.773272:0:27097:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018877.773284:0:27097:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092155240 going to sleep for 6 seconds 00000100:00100000:2.0:1717018877.773335:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892352 00000100:00100000:2.0:1717018877.773359:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1717018877.773363:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27097:x1800422819892352:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018877.773496:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27097:x1800422819892352:12345-0@lo:502:llog_process_th.0 Request processed in 133us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018877.773502:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:3.0:1717018877.773555:0:27097:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27097:1800422819892352:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018877.773571:0:27097:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 101 count 99 00000020:01000000:2.0:1717018877.773671:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 98-100 (rc=0) 10000000:01000000:2.0:1717018877.773687:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018877.773692:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.773700:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018877.773714:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1717018877.773715:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1717018877.773717:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1717018877.773729:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.773734:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.773742:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.773750:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.773768:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.773775:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018877.773953:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892416 00000100:00100000:3.0:1717018877.773974:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:3.0:1717018877.773977:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819892416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018877.773982:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018877.773990:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1807 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.774002:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1807 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.774008:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1807 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.774013:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1eac0, rc 0) 00000100:00100000:3.0:1717018877.774030:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819892416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 52us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.774034:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1717018877.774079:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.774087:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.774093:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.774119:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.774135:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.774141:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018877.774301:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892480 00000100:00100000:3.0:1717018877.774320:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:3.0:1717018877.774323:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819892480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.774451:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819892480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 127us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.774456:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1717018877.774554:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.774571:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892544:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.774604:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.774611:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018877.774729:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892544 00000100:00100000:3.0:1717018877.774746:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:3.0:1717018877.774753:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819892544:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.774966:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819892544:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 212us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.774971:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1717018877.775066:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892544:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717018877.775781:0:27098:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:2.0:1717018877.775943:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1717018877.775958:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1717018877.775962:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.775969:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018877.775975:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018877.775977:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:2.0:1717018877.775979:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018877.775990:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.775995:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.776000:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.776009:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.776032:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.776050:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018877.776294:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892608 00000100:00100000:3.0:1717018877.776315:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:3.0:1717018877.776318:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819892608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018877.776323:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018877.776331:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1815 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.776343:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1815 expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.776348:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1815 expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018877.776353:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1e880, rc 0) 00000100:00100000:3.0:1717018877.776542:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819892608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.776546:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1717018877.776609:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018877.776616:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.776630:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.776657:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018877.776819:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018877.776939:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018877.777049:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892672 00000100:00100000:3.0:1717018877.777069:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:3.0:1717018877.777072:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819892672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018877.777204:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819892672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 130us (384us total) trans 0 rc -2/-2 00000100:00100000:3.0:1717018877.777208:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1717018877.777298:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731a140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819892672:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1717018877.777313:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1717018877.777316:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018877.777322:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018877.967485:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018877.967530:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018877.967562:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018877.967591:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668032 00000100:00100000:2.0:1717018877.967621:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668096 00000100:00100000:0.0:1717018877.967718:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838667968 00000100:00100000:0.0:1717018877.967872:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 697 00000100:00100000:0.0:1717018877.967876:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:1836:x1800422838667968:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00010000:00000080:0.0:1717018877.967902:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013731f6c0 x1800422838667968/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:229/0 lens 224/224 e 0 to 0 dl 1717018964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:0.0:1717018877.967938:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:1836:x1800422838667968:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 62us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018877.967943:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 697 00000100:00100000:2.0:1717018877.968600:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 986 00000100:00100000:2.0:1717018877.968604:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838668032:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018877.968627:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 987 00000100:00100000:2.0:1717018877.968628:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731a140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838668032:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 25us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.968632:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b050c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838668096:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018877.968633:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 986 00000100:00100000:3.0:1717018877.968659:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b050c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838668096:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 27us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018877.968664:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 987 00010000:00010000:2.0:1717018878.412290:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1717018878.540580:0:27163:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1717018878.540589:0:27163:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1717018878.540593:0:27163:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1717018878.540971:0:27163:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1717018878.540978:0:27163:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1717018878.541013:0:27163:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_22c.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1717018878.541917:0:27164:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 90 marker 61 1->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0001_UUID 20000000:01000000:3.0:1717018878.542001:0:27164:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 92 marker 61 2->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:3.0:1717018878.542048:0:27164:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 96 count 94 00000040:00080000:1.0:1717018878.542476:0:27163:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].96, 224 off25984 20000000:01000000:1.0:1717018878.542494:0:27163:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_22c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1717018878.542566:0:27163:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].97, 144 off26128 00000040:00080000:1.0:1717018878.542590:0:27163:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].98, 224 off26352 20000000:01000000:1.0:1717018878.542904:0:27163:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_22c.lustre-OST0001_UUID fl=4 20000000:01000000:1.0:1717018878.543404:0:27165:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 95 marker 62 1->4: lustre-clilov add lustre.test_22c.lustre-OST0001_UUID 20000000:01000000:1.0:1717018878.543449:0:27165:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 97 marker 62 2->4: lustre-clilov add lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:1.0:1717018878.543512:0:27165:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 101 count 99 00000040:00080000:0.0:1717018878.543774:0:27163:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].101, 224 off26776 20000000:01000000:0.0:1717018878.543789:0:27163:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce022 lustre test_22c lustre-OST0001_UUID (null) 00000040:00080000:0.0:1717018878.543844:0:27163:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].102, 136 off26912 00000040:00080000:0.0:1717018878.543881:0:27163:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].103, 224 off27136 10000000:01000000:0.0:1717018878.543892:0:27163:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1717018878.543906:0:27163:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543923:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543927:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543936:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543940:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17cf expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543946:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17dd expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543949:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17eb expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543952:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543955:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1807 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543958:0:27163:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1815 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543961:0:27163:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.543995:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1815 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544005:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1815 expref: 17 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.544014:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2351300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892736:0@lo:104: 00000100:00100000:0.0:1717018878.544074:0:27163:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018878.544115:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1807 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544121:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1807 expref: 17 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.544127:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2354c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892800:0@lo:104: 00000100:00100000:0.0:1717018878.544143:0:27163:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018878.544172:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544178:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 17 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.544184:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892864:0@lo:104: 00000100:00100000:0.0:1717018878.544204:0:27163:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018878.544232:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c17eb expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544238:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c17eb expref: 17 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.544244:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef463c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892928:0@lo:104: 00000100:00100000:3.0:1717018878.544261:0:6615:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1717018878.544262:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c17dd expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544267:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c17dd expref: 17 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.544271:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892992:0@lo:104: 00000100:00100000:3.0:1717018878.544291:0:6615:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018878.544337:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892736 00000100:00100000:2.0:1717018878.544354:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892800 00000100:00100000:1.0:1717018878.544369:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892864 00000100:00100000:2.0:1717018878.544375:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892928 00000100:00100000:1.0:1717018878.544379:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1717018878.544384:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2356d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+6:27163:x1800422819892736:12345-0@lo:104: 00000100:00100000:2.0:1717018878.544386:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1717018878.544389:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a23517c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+6:27163:x1800422819892800:12345-0@lo:104: 00000100:00100000:3.0:1717018878.544449:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1717018878.544454:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880081480850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+6:27163:x1800422819892864:12345-0@lo:104: 00010000:00010000:1.0:1717018878.544475:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1717018878.544480:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2356d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+6:27163:x1800422819892736:12345-0@lo:104: Request processed in 96us (407us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018878.544481:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1717018878.544485:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a23517c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+6:27163:x1800422819892800:12345-0@lo:104: Request processed in 95us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018878.544487:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1717018878.544490:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1717018878.544501:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1717018878.544504:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086968e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:27163:x1800422819892928:12345-0@lo:104: 00010000:00010000:2.0:1717018878.544511:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018878.544515:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.544523:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2d00 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018878.544526:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.544529:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1717018878.544532:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086968e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:27163:x1800422819892928:12345-0@lo:104: Request processed in 28us (242us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018878.544533:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018878.544537:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 10000000:00010000:2.0:1717018878.544538:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018878.544542:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018878.544552:0:6620:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717018878.544553:0:12712:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018878.544556:0:12712:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544561:0:12712:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e3840 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:1.0:1717018878.544562:0:6620:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018878.544562:0:12712:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.544564:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.544567:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1717018878.544567:0:12712:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.544568:0:6620:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1b00 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:2.0:1717018878.544569:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1717018878.544570:0:6620:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018878.544571:0:12712:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018878.544573:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880081480850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:27163:x1800422819892864:12345-0@lo:104: Request processed in 118us (367us total) trans 0 rc 0/0 00010000:00010000:1.0:1717018878.544574:0:6620:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018878.544574:0:12712:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1717018878.544579:0:6620:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018878.544582:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00010000:00010000:2.0:1717018878.544583:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018878.544583:0:6620:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018878.544583:0:12712:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.544587:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d2d00/0x81e56358f42c1815 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c181c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544587:0:12712:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018878.544596:0:6620:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544597:0:12712:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.544600:0:6620:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018878.544600:0:12712:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e3840/0x81e56358f42c17eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17f2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.544603:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717018878.544604:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.544604:0:6620:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544607:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.544608:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2ac0 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:0.0:1717018878.544608:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018878.544609:0:6620:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1b00/0x81e56358f42c1807 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c180e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544609:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1717018878.544610:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.544614:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018878.544615:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:00010000:2.0:1717018878.544617:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.544617:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018878.544618:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018878.544619:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717018878.544621:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1717018878.544625:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132b06d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819893056:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018878.544631:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.544634:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.544635:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018878.544637:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.544641:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d2ac0/0x81e56358f42c17f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1800 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018878.544647:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819893120:0@lo:103:ldlm_bl_06.0 00010000:00010000:2.0:1717018878.544647:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.544648:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.544650:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018878.544652:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018878.544660:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1717018878.544666:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007d6e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819893248:0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1717018878.544672:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893056 00000100:00100000:0.0:1717018878.544673:0:27163:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018878.544674:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717018878.544685:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1815 expref: 18 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.544695:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1717018878.544697:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018878.544700:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819893184:0@lo:103:ldlm_bl_02.0 00010000:00010000:0.0:1717018878.544701:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c17cf expref: 18 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544709:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c17cf expref: 18 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:1.0:1717018878.544710:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893120 00000100:00100000:0.0:1717018878.544714:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40980 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893312:0@lo:104: 00010000:00010000:1.0:1717018878.544717:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17eb expref: 19 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.544718:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018878.544734:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893248 00000100:00100000:0.0:1717018878.544734:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893184 00000100:00100000:1.0:1717018878.544736:0:10306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75357 00000100:00100000:1.0:1717018878.544739:0:10306:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6df8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+21:2854:x1800422819893056:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018878.544742:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00010000:00010000:0.0:1717018878.544742:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1807 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.544747:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75358 00010000:00010000:1.0:1717018878.544748:0:10306:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018878.544751:0:10306:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1815 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.544752:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+21:2852:x1800422819893120:12345-0@lo:103:ldlm_bl_06.0 00010000:00010000:1.0:1717018878.544758:0:10306:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1815 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:2.0:1717018878.544759:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75359 00010000:00010000:3.0:1717018878.544760:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1717018878.544761:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75360 00000100:00100000:2.0:1717018878.544763:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d6eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+21:2855:x1800422819893248:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018878.544764:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+21:2852:x1800422819893184:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:2.0:1717018878.544769:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018878.544769:0:10306:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1717018878.544769:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018878.544771:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00010000:00010000:0.0:1717018878.544771:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1807 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00010000:00010000:3.0:1717018878.544773:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17eb expref: 21 pid: 8249 timeout: 2011 lvb_type: 0 00010000:00010000:2.0:1717018878.544778:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00010000:00010000:0.0:1717018878.544783:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1807 expref: 21 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:1.0:1717018878.544790:0:10306:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6df8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+21:2854:x1800422819893056:12345-0@lo:103:ldlm_bl_05.0 Request processed in 50us (138us total) trans 0 rc 0/0 00010000:00010000:3.0:1717018878.544793:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c17eb expref: 21 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:1.0:1717018878.544795:0:10306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75357 00010000:00010000:2.0:1717018878.544809:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1717018878.544809:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1717018878.544811:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018878.544848:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d6eda40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819893248:12345-0@lo:103:ldlm_bl_05.0 Request processed in 84us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018878.544848:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696ed40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+20:2852:x1800422819893184:12345-0@lo:103:ldlm_bl_02.0 Request processed in 83us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018878.544853:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75360 00000100:00100000:2.0:1717018878.544854:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75359 00000100:00100000:3.0:1717018878.544861:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819893120:12345-0@lo:103:ldlm_bl_06.0 Request processed in 108us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018878.544866:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75358 00000100:00100000:2.0:1717018878.544877:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007d6e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819893248:0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018878.544877:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132b06d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819893056:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018878.544897:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819893184:0@lo:103:ldlm_bl_02.0 00000100:00100000:0.0:1717018878.544903:0:27163:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018878.544904:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef417c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819893120:0@lo:103:ldlm_bl_06.0 00000100:00100000:3.0:1717018878.544925:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819892992 00010000:00010000:0.0:1717018878.544932:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544943:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 17 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.544945:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893312 00000100:00100000:0.0:1717018878.544955:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef41300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893376:0@lo:104: 00000100:00100000:1.0:1717018878.544959:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1717018878.544963:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef45f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:27163:x1800422819892992:12345-0@lo:104: 00000100:00100000:3.0:1717018878.544966:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1717018878.544969:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef40e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:27163:x1800422819893312:12345-0@lo:104: 00000100:00100000:0.0:1717018878.544971:0:27163:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018878.544985:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.544991:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 8 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.544998:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893440:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717018878.544999:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1717018878.545002:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1717018878.545002:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef45f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:27163:x1800422819892992:12345-0@lo:104: Request processed in 39us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018878.545006:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef40e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:27163:x1800422819893312:12345-0@lo:104: Request processed in 36us (102us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018878.545008:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1717018878.545011:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1717018878.545023:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893376 00010000:00010000:3.0:1717018878.545028:0:14979:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1717018878.545035:0:14979:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018878.545036:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1717018878.545039:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef43dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:27163:x1800422819893376:12345-0@lo:104: 00010000:00010000:3.0:1717018878.545041:0:14979:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d18c0 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018878.545043:0:14979:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.545048:0:14979:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018878.545056:0:14979:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018878.545060:0:14979:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018878.545061:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1717018878.545064:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef43dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:27163:x1800422819893376:12345-0@lo:104: Request processed in 25us (93us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018878.545067:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00010000:00010000:3.0:1717018878.545081:0:14979:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.545084:0:14979:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018878.545098:0:14979:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.545101:0:14979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d18c0/0x81e56358f42c17dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17e4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.545104:0:6619:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018878.545107:0:6619:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018878.545108:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1717018878.545110:0:14979:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1717018878.545111:0:14979:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.545113:0:6619:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0240 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:3.0:1717018878.545114:0:14979:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1200 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018878.545114:0:6619:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018878.545115:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819893504:0@lo:103:ldlm_bl_04.0 10000000:00010000:3.0:1717018878.545116:0:14979:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.545119:0:6619:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.545120:0:14979:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018878.545123:0:14979:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018878.545126:0:14979:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1717018878.545131:0:6619:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018878.545133:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1717018878.545135:0:6619:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018878.545136:0:14979:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.545139:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.545146:0:6619:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.545147:0:14979:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018878.545148:0:27163:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.545151:0:6619:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1717018878.545151:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893504 00010000:00010000:3.0:1717018878.545153:0:14979:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.545154:0:27163:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 8 pid: 8248 timeout: 2011 lvb_type: 0 00010000:00010000:2.0:1717018878.545156:0:6619:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018878.545157:0:14979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c17c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17c8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018878.545160:0:6619:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d0240/0x81e56358f42c17cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c17d6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.545160:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17dd expref: 18 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.545160:0:27163:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef44c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893696:192.168.203.26@tcp:104: 00010000:00010000:3.0:1717018878.545164:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018878.545165:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018878.545167:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.545171:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018878.545172:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018878.545173:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75361 00010000:00010000:2.0:1717018878.545174:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018878.545175:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007d6e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819893632:0@lo:103:ldlm_bl_01.0 00000100:00100000:1.0:1717018878.545176:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819893504:12345-0@lo:103:ldlm_bl_04.0 00000100:00100000:0.0:1717018878.545181:0:27163:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a69c9240 going to sleep for 6 seconds 00010000:00010000:1.0:1717018878.545182:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018878.545184:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17dd expref: 18 pid: 8249 timeout: 2011 lvb_type: 0 00010000:00010000:1.0:1717018878.545189:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c17dd expref: 18 pid: 8249 timeout: 2011 lvb_type: 0 00010000:00010000:0.0:1717018878.545190:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1e880/0x81e56358f42c181c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1815 expref: 18 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.545197:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717018878.545197:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1717018878.545197:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2351300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892736:0@lo:104: 00010000:00010000:0.0:1717018878.545204:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1eac0/0x81e56358f42c180e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1807 expref: 17 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.545210:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2354c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892800:0@lo:104: 00000100:00100000:3.0:1717018878.545214:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1717018878.545216:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e2400/0x81e56358f42c1800 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c17f9 expref: 16 pid: 8250 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.545218:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819893568:0@lo:103:ldlm_bl_04.0 00000100:00100000:1.0:1717018878.545220:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+16:2854:x1800422819893504:12345-0@lo:103:ldlm_bl_04.0 Request processed in 43us (86us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018878.545221:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893632 00000100:00100000:1.0:1717018878.545225:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75361 00010000:00010000:2.0:1717018878.545229:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17cf expref: 16 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.545232:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018878.545236:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892864:0@lo:104: 00010000:00010000:0.0:1717018878.545244:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d3180/0x81e56358f42c17f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c17eb expref: 15 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:1.0:1717018878.545245:0:11917:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893568 00010000:00010000:1.0:1717018878.545252:0:11917:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 15 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:2.0:1717018878.545254:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75362 00000100:00100000:2.0:1717018878.545256:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+15:2853:x1800422819893632:12345-0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018878.545257:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef463c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892928:0@lo:104: 00010000:00010000:2.0:1717018878.545262:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018878.545265:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17cf expref: 15 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.545268:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75363 00010000:00010000:2.0:1717018878.545270:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c17cf expref: 15 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.545271:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+15:2853:x1800422819893568:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:0.0:1717018878.545276:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018878.545277:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1717018878.545278:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 15 pid: 8248 timeout: 2011 lvb_type: 0 00010000:00010000:0.0:1717018878.545283:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 15 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:1.0:1717018878.545284:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819893504:0@lo:103:ldlm_bl_04.0 00010000:00010000:0.0:1717018878.545289:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018878.545300:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696a600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+15:2853:x1800422819893632:12345-0@lo:103:ldlm_bl_01.0 Request processed in 42us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018878.545301:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+15:2853:x1800422819893568:12345-0@lo:103:ldlm_bl_04.0 Request processed in 30us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018878.545305:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75362 00000100:00100000:0.0:1717018878.545306:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75363 00000100:00100000:3.0:1717018878.545315:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819893568:0@lo:103:ldlm_bl_04.0 00010000:00010000:0.0:1717018878.545320:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1f80/0x81e56358f42c17e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c17dd expref: 13 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:3.0:1717018878.545323:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007d6e9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819893632:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018878.545327:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819892992:0@lo:104: 00010000:00010000:0.0:1717018878.545335:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1d40/0x81e56358f42c17d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c17cf expref: 12 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.545340:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40980 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893312:0@lo:104: 00010000:00010000:0.0:1717018878.545345:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1200/0x81e56358f42c17c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c17c1 expref: 11 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:0.0:1717018878.545359:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef41300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893376:0@lo:104: 00000100:00100000:2.0:1717018878.547864:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018878.547939:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018878.547968:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668160 00010000:00010000:2.0:1717018878.547999:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 9 pid: 8249 timeout: 2011 lvb_type: 0 00000100:00100000:2.0:1717018878.548038:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668224 00010000:00010000:2.0:1717018878.548045:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 10 pid: 8248 timeout: 2011 lvb_type: 0 00000100:00100000:2.0:1717018878.548058:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75364 00000100:00100000:0.0:1717018878.548061:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893440:192.168.203.26@tcp:104: 00000100:00100000:2.0:1717018878.548063:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dd5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+10:1836:x1800422838668160:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 00000100:00100000:0.0:1717018878.548071:0:27163:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef44c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27163:1800422819893696:192.168.203.26@tcp:104: 00010000:00010000:2.0:1717018878.548076:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018878.548079:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 10 pid: 8249 timeout: 2011 lvb_type: 0 00010000:00010000:2.0:1717018878.548085:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 10 pid: 8249 timeout: 2011 lvb_type: 0 00010000:00010000:2.0:1717018878.548099:0:6616:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79e880/0x81e56358f42c17ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36762 expref: 10 pid: 8249 timeout: 2011 lvb_type: 0 00010000:00010000:2.0:1717018878.548110:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1717018878.548117:0:27163:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018878.548285:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75365 00000100:00100000:1.0:1717018878.548290:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d6e9c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838668224:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1717018878.548298:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018878.548301:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 9 pid: 8248 timeout: 2011 lvb_type: 0 00010000:00010000:1.0:1717018878.548319:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 9 pid: 8248 timeout: 2011 lvb_type: 0 00010000:00010000:1.0:1717018878.548327:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d0fc0/0x81e56358f42c17b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3675b expref: 9 pid: 8248 timeout: 2011 lvb_type: 0 00010000:00010000:1.0:1717018878.548337:0:8093:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548343:0:8093:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548356:0:8093:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548361:0:8093:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548364:0:8093:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548369:0:8093:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548373:0:8093:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e0b40 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1717018878.548377:0:8093:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548382:0:8093:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548391:0:8093:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018878.548402:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1717018878.548434:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d6e9c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:461e9689-0dac-4669-87c3-00abdddc539f+8:1835:x1800422838668224:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 Request processed in 144us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018878.548440:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75365 00000100:00100000:2.0:1717018878.548709:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dd5850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+7:1836:x1800422838668160:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 Request processed in 645us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018878.548714:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75364 00010000:00010000:0.0:1717018878.548907:0:27163:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.548914:0:27163:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018878.548919:0:27163:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e0b40/0x81e56358f42c1823 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27163 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018879.036663:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef44c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819893760:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1717018879.036738:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.036846:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893760 00000100:00100000:2.0:1717018879.036903:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1717018879.036908:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+11:2854:x1800422819893760:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.037431:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+11:2854:x1800422819893760:12345-0@lo:400:kworker/u8:1.0 Request processed in 523us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.037438:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1717018879.039028:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef44c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819893760:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1717018879.039058:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1717018879.039066:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2854:1800422819893824:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1717018879.039109:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.039261:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef41300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819893888:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.039286:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018879.039287:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893824 00000100:00100000:2.0:1717018879.039301:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1717018879.039305:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819893952:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1717018879.039313:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893888 00000100:00100000:2.0:1717018879.039323:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018879.039324:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 698 00000100:00100000:0.0:1717018879.039327:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b829c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2854:x1800422819893824:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1717018879.039342:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008b829c80 x1800422819893824/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:231/0 lens 224/224 e 0 to 0 dl 1717018966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1717018879.039343:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1717018879.039346:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007d6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819893888:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:2.0:1717018879.039356:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88007d6eda40 x1800422819893888/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:231/0 lens 224/224 e 0 to 0 dl 1717018966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1717018879.039370:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b829c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2854:x1800422819893824:12345-0@lo:400:kworker/u8:1.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.039375:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 698 00000100:00100000:2.0:1717018879.039377:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007d6eda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819893888:12345-0@lo:400:kworker/u8:1.0 Request processed in 30us (91us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.039382:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 699 00000100:00100000:2.0:1717018879.039399:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819893952 00000100:00100000:2.0:1717018879.039418:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1717018879.039421:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ac97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819893952:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.039441:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ac97c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819893952:12345-0@lo:400:kworker/u8:1.0 Request processed in 20us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.039446:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1717018879.039482:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819893952:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.039489:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef41300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819893888:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018879.039561:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819894080:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018879.039590:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.039623:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1717018879.039626:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819894016:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018879.039642:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018879.039691:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894080 00000100:00100000:0.0:1717018879.039792:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 700 00000100:00100000:0.0:1717018879.039796:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819894080:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1717018879.039812:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008696b440 x1800422819894080/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:231/0 lens 224/224 e 0 to 0 dl 1717018966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1717018879.039911:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2854:1800422819893824:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.039971:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894016 00000100:00100000:0.0:1717018879.040073:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819894080:12345-0@lo:400:kworker/u8:1.0 Request processed in 276us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.040078:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 700 00000100:00100000:3.0:1717018879.040118:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819894080:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.040196:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1717018879.040199:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819894016:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018879.040223:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819894016:12345-0@lo:400:kworker/u8:1.0 Request processed in 24us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.040227:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:3.0:1717018879.040308:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819894016:0@lo:400:kworker/u8:1.0 00010000:00010000:1.0:1717018879.414117:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717018879.504954:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018879.504962:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 101 10000000:01000000:2.0:1717018879.504969:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018879.505011:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.505021:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.505030:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.505053:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.505119:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.505156:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.505273:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894144 00000100:00100000:0.0:1717018879.505313:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1717018879.505318:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819894144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018879.505329:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018879.505343:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c182a expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.505364:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c182a expref: 12 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.505371:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c182a expref: 12 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.505377:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1680, rc 0) 00000100:00100000:0.0:1717018879.505419:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819894144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.505424:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1717018879.505563:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8980 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018879.505583:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018879.505592:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018879.505654:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.505696:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.505734:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800921b6cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.506313:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894208 00000100:00100000:0.0:1717018879.506348:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1717018879.506352:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819894208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.506712:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819894208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 359us (1015us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.506734:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:3.0:1717018879.506737:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.506775:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.506813:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.506858:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800921b6cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.506915:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894272 00000100:00100000:0.0:1717018879.507000:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1717018879.507012:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819894272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.507180:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819894272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.507185:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:3.0:1717018879.507267:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.507853:0:27167:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27167:1800422819894336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.507880:0:27167:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.507900:0:27167:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.507915:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894336 00000100:00100000:0.0:1717018879.508117:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:0.0:1717018879.508122:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27167:x1800422819894336:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018879.508463:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27167:x1800422819894336:12345-0@lo:502:llog_process_th.0 Request processed in 340us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.508469:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00000100:00100000:3.0:1717018879.508541:0:27167:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27167:1800422819894336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.508574:0:27167:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27167:1800422819894400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.508597:0:27167:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.508607:0:27167:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695b40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018879.508614:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894400 00000100:00100000:2.0:1717018879.508637:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1717018879.508640:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:27167:x1800422819894400:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018879.508807:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:27167:x1800422819894400:12345-0@lo:502:llog_process_th.0 Request processed in 166us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.508813:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:3.0:1717018879.508920:0:27167:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27167:1800422819894400:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018879.508942:0:27167:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 104 count 102 00000020:01000000:1.0:1717018879.509218:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 101-103 (rc=0) 10000000:01000000:1.0:1717018879.509242:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1717018879.509247:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018879.509257:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018879.509266:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1717018879.509268:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 96 10000000:01000000:1.0:1717018879.509271:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1717018879.509290:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018879.509296:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018879.509307:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018879.509317:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018879.509340:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018879.509632:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e7529c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.509671:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894464 00000100:00100000:0.0:1717018879.509714:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1010 00000100:00100000:0.0:1717018879.509718:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819894464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018879.509724:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018879.509735:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1838 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.509752:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1838 expref: 13 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.509760:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1838 expref: 13 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.509767:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e3180, rc 0) 00000100:00100000:0.0:1717018879.509802:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819894464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.509807:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1010 00000100:00100000:1.0:1717018879.509862:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018879.509871:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018879.509877:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018879.509914:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018879.509930:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018879.509936:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e7529c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018879.509984:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894528 00000100:00100000:2.0:1717018879.510003:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1011 00000100:00100000:2.0:1717018879.510005:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819894528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.510086:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819894528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.510090:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1011 00000100:00100000:1.0:1717018879.510200:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018879.510219:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018879.510243:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018879.510249:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e7529c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.510311:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894592 00000100:00100000:0.0:1717018879.510331:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1012 00000100:00100000:0.0:1717018879.510334:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819894592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.510678:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819894592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 343us (434us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.510683:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1012 00000100:00100000:1.0:1717018879.510735:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018879.511058:0:27168:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27168:1800422819894656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018879.511082:0:27168:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018879.511579:0:27168:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e7529c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.511640:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894656 00000100:00100000:0.0:1717018879.511668:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1013 00000100:00100000:0.0:1717018879.511672:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27168:x1800422819894656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018879.513349:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27168:x1800422819894656:12345-0@lo:502:llog_process_th.0 Request processed in 1672us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.513359:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1013 00000100:00100000:1.0:1717018879.513480:0:27168:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27168:1800422819894656:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1717018879.513520:0:27168:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018879.513529:0:27168:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018879.513530:0:27168:0:(obd_config.c:1460:class_process_config()) marker 65 (0x1) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0001_UUID 00000020:00000080:1.0:1717018879.513533:0:27168:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1717018879.513548:0:27168:0:(lod_pool.c:669:lod_pool_remove()) lustre-OST0001_UUID removed from test_22c 00000020:01000004:1.0:1717018879.514064:0:27169:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff880090828000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1717018879.514068:0:27169:0:(obd_mount.c:668:lustre_put_lsi()) put ffff880090828000 4 00000100:00100000:2.0:1717018879.514248:0:27168:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27168:1800422819894720:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018879.514313:0:27168:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.514338:0:27168:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de323c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.514684:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894720 00000100:00100000:0.0:1717018879.514714:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1014 00000100:00100000:0.0:1717018879.514718:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27168:x1800422819894720:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018879.514995:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27168:x1800422819894720:12345-0@lo:502:llog_process_th.0 Request processed in 275us (682us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.515001:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1014 00000100:00100000:2.0:1717018879.515118:0:27168:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27168:1800422819894720:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1717018879.515148:0:27168:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1717018879.515153:0:27168:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1717018879.515155:0:27168:0:(obd_config.c:1460:class_process_config()) marker 65 (0x2) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:2.0:1717018879.515160:0:27168:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 99 count 97 00000020:01000000:2.0:1717018879.515192:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 96-98 (rc=0) 10000000:01000000:2.0:1717018879.515305:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1717018879.515312:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.515320:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018879.515326:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018879.515328:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 101 10000000:01000000:2.0:1717018879.515330:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018879.515345:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.515350:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.515364:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.515374:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.515404:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.515428:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e840 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.515575:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894784 00000100:00100000:0.0:1717018879.515600:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1015 00000100:00100000:0.0:1717018879.515603:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819894784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018879.515611:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018879.515625:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1846 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.515641:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1846 expref: 14 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.515646:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1846 expref: 14 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.515652:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e3a80, rc 0) 00000100:00100000:0.0:1717018879.515673:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819894784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.515678:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1015 00000100:00100000:2.0:1717018879.515683:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018879.515693:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.515698:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.515730:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.515749:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.515757:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e840 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.515760:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894848 00000100:00100000:0.0:1717018879.515770:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1016 00000100:00100000:0.0:1717018879.515772:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819894848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.516007:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819894848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.516011:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1016 00000100:00100000:2.0:1717018879.516108:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.516130:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.516287:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.516308:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e840 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.516352:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894912 00000100:00100000:0.0:1717018879.516366:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1017 00000100:00100000:0.0:1717018879.516370:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819894912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.516532:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819894912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 161us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.516538:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1017 00000100:00100000:2.0:1717018879.516584:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819894912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.517068:0:27170:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27170:1800422819894976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.517097:0:27170:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.517383:0:27170:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695b40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.517578:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819894976 00000100:00100000:0.0:1717018879.518077:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1018 00000100:00100000:0.0:1717018879.518081:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27170:x1800422819894976:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018879.518440:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27170:x1800422819894976:12345-0@lo:502:llog_process_th.0 Request processed in 358us (1342us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.518446:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1018 00000100:00100000:3.0:1717018879.518854:0:27170:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27170:1800422819894976:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.518898:0:27170:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27170:1800422819895040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.518926:0:27170:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.518938:0:27170:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695b40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018879.519248:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895040 00000100:00100000:2.0:1717018879.519267:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1019 00000100:00100000:2.0:1717018879.519271:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:27170:x1800422819895040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018879.519407:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:27170:x1800422819895040:12345-0@lo:502:llog_process_th.0 Request processed in 136us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.519416:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1019 00000100:00100000:3.0:1717018879.519514:0:27170:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27170:1800422819895040:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018879.519533:0:27170:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 104 count 102 00000020:01000000:2.0:1717018879.519585:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 101-103 (rc=0) 10000000:01000000:2.0:1717018879.519603:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018879.519608:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.519616:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018879.519622:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1717018879.519624:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1717018879.519626:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1717018879.519642:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.519648:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.519653:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.519662:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.519680:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.519687:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.519695:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895104 00000100:00100000:0.0:1717018879.519718:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1020 00000100:00100000:0.0:1717018879.519721:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819895104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018879.519728:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018879.519737:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1854 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.519758:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1854 expref: 15 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.519765:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1854 expref: 15 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.519770:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e2f40, rc 0) 00000100:00100000:0.0:1717018879.519810:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819895104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.519815:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1020 00000100:00100000:2.0:1717018879.520330:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018879.520341:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.520347:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.520386:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.520404:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.520425:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.520645:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895168 00000100:00100000:0.0:1717018879.520668:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1021 00000100:00100000:0.0:1717018879.520671:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819895168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.520761:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819895168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.520767:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1021 00000100:00100000:2.0:1717018879.520783:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.520801:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.520851:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.520867:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.521098:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895232 00000100:00100000:0.0:1717018879.521130:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1022 00000100:00100000:0.0:1717018879.521133:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819895232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.521652:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819895232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 517us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.521655:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.521658:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1022 00000040:00080000:3.0:1717018879.522280:0:27171:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1717018879.522709:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1717018879.522725:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1717018879.522730:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.522737:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018879.522743:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018879.522745:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 101 10000000:01000000:2.0:1717018879.522747:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018879.522763:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.522767:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.522773:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.522799:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.522845:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.522866:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018879.522916:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895296 00000100:00100000:3.0:1717018879.522934:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1023 00000100:00100000:3.0:1717018879.522936:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819895296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018879.522943:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018879.522952:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1862 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018879.522969:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1862 expref: 16 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018879.522974:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1862 expref: 16 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018879.522979:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1f600, rc 0) 00000100:00100000:3.0:1717018879.523008:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819895296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018879.523016:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1023 00000100:00100000:2.0:1717018879.523076:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018879.523085:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.523090:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.523115:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.523131:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.523137:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018879.523194:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895360 00000100:00100000:3.0:1717018879.523205:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00000100:00100000:3.0:1717018879.523207:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d912850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819895360:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.523323:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d912850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819895360:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 115us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018879.523328:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1717018879.523372:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895360:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.523389:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.523414:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.523421:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:3.0:1717018879.523471:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895424 00000100:00100000:3.0:1717018879.523483:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1717018879.523611:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819895424:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.524243:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819895424:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 632us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018879.524248:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:2.0:1717018879.524310:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895424:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.524878:0:27172:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27172:1800422819895488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.524908:0:27172:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.524930:0:27172:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.524954:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895488 00000100:00100000:0.0:1717018879.524985:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:0.0:1717018879.524988:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27172:x1800422819895488:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018879.525300:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27172:x1800422819895488:12345-0@lo:502:llog_process_th.0 Request processed in 311us (392us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.525306:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1717018879.525320:0:27172:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27172:1800422819895488:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.525346:0:27172:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27172:1800422819895552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018879.525366:0:27172:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.525384:0:27172:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.525544:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895552 00000100:00100000:0.0:1717018879.525564:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:0.0:1717018879.525567:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27172:x1800422819895552:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018879.525688:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27172:x1800422819895552:12345-0@lo:502:llog_process_th.0 Request processed in 120us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.525694:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1717018879.525758:0:27172:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27172:1800422819895552:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018879.525775:0:27172:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 104 count 102 00000020:01000000:2.0:1717018879.525965:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 101-103 (rc=0) 10000000:01000000:2.0:1717018879.525984:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018879.525989:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.525998:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018879.526014:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1717018879.526015:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1717018879.526018:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1717018879.526033:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.526037:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.526042:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018879.526051:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.526071:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018879.526141:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.526569:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895616 00000100:00100000:0.0:1717018879.526586:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:0.0:1717018879.526589:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819895616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018879.526596:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018879.526606:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1870 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.526622:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1870 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.526637:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1870 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.526643:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e3600, rc 0) 00000100:00100000:0.0:1717018879.527151:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819895616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 559us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.527157:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1717018879.528086:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018879.528110:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018879.528117:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018879.528165:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.528191:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.528205:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018879.528440:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895680 00000100:00100000:0.0:1717018879.528476:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:0.0:1717018879.528479:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819895680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.528564:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819895680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018879.528568:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1717018879.528647:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.528667:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.528693:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018879.528700:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695cc0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018879.528742:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895744 00000100:00100000:2.0:1717018879.528755:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:2.0:1717018879.528757:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819895744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018879.528918:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819895744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 159us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.528923:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:3.0:1717018879.529043:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717018879.530257:0:27173:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:0.0:1717018879.530439:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1717018879.530468:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1717018879.530473:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.530481:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018879.530489:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018879.530491:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:0.0:1717018879.530493:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018879.530512:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.530517:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018879.530529:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018879.530542:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef450c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018879.530578:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018879.530599:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4cedd80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018879.530726:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895808 00000100:00100000:2.0:1717018879.530748:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:2.0:1717018879.530752:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819895808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018879.530758:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018879.530768:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c187e expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.530790:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c187e expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.530797:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c187e expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018879.530802:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0000, rc 0) 00000100:00100000:2.0:1717018879.531216:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819895808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 463us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018879.531221:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1717018879.531385:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef450c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018879.531396:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018879.531403:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018879.531440:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018879.531476:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018879.531499:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e7529c0 going to sleep for 6 seconds 00000100:00100000:3.0:1717018879.531867:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895872 00000100:00100000:3.0:1717018879.531892:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:3.0:1717018879.531895:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819895872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018879.532887:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819895872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 988us (1408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1717018879.532894:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1717018879.532982:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819895872:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1717018879.533096:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1717018879.533101:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018879.533109:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000020:00000080:1.0:1717018880.193401:0:27303:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1717018880.193408:0:27303:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1717018880.193411:0:27303:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1717018880.193980:0:27303:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1717018880.193987:0:27303:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1717018880.194087:0:27303:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_22c fl=4 20000000:01000000:1.0:1717018880.194816:0:27304:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 83 marker 57 1->4: lustre-MDT0000-mdtlov new lustre.test_22c 20000000:01000000:1.0:1717018880.194913:0:27304:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 85 marker 57 2->4: lustre-MDT0000-mdtlov new lustre.test_22c 00000040:00080000:1.0:1717018880.194971:0:27304:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 99 count 97 00000040:00080000:2.0:1717018880.195329:0:27303:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].99, 224 off26576 20000000:01000000:2.0:1717018880.195341:0:27303:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_22c (null) (null) 00000040:00080000:2.0:1717018880.195409:0:27303:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].100, 120 off26696 00000040:00080000:2.0:1717018880.195444:0:27303:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].101, 224 off26920 20000000:01000000:2.0:1717018880.195811:0:27303:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_22c fl=4 20000000:01000000:1.0:1717018880.196317:0:27305:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 88 marker 58 1->4: lustre-clilov new lustre.test_22c 20000000:01000000:1.0:1717018880.196381:0:27305:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 91 marker 58 2->4: lustre-clilov new lustre.test_22c 00000040:00080000:1.0:1717018880.196427:0:27305:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 104 count 102 00000040:00080000:2.0:1717018880.196751:0:27303:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].104, 224 off27360 20000000:01000000:2.0:1717018880.196760:0:27303:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce023 lustre test_22c (null) (null) 00000040:00080000:2.0:1717018880.196795:0:27303:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].105, 112 off27472 00000040:00080000:2.0:1717018880.196994:0:27303:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].106, 224 off27696 10000000:01000000:2.0:1717018880.197007:0:27303:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1717018880.197020:0:27303:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197037:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c182a expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197043:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1838 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197047:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1846 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197058:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1854 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197062:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1862 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197066:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1870 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197071:0:27303:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c187e expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197075:0:27303:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197103:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c187e expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197111:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c187e expref: 17 pid: 8250 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197120:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819895936:0@lo:104: 00000100:00100000:2.0:1717018880.197163:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018880.197193:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1870 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197199:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1870 expref: 17 pid: 8250 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197204:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896000:0@lo:104: 00000100:00100000:3.0:1717018880.197213:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819895936 00000100:00100000:2.0:1717018880.197217:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018880.197249:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1862 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197255:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1862 expref: 17 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197260:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acdf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896064:0@lo:104: 00000100:00100000:2.0:1717018880.197276:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018880.197307:0:6895:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1717018880.197309:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1854 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197314:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1854 expref: 17 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:3.0:1717018880.197315:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896000 00000100:00100000:2.0:1717018880.197319:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac84c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896128:0@lo:104: 00000100:00100000:3.0:1717018880.197323:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896064 00000100:00100000:3.0:1717018880.197330:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1717018880.197333:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018880.197338:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092acaac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+5:27303:x1800422819895936:12345-0@lo:104: 00010000:00010000:2.0:1717018880.197342:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1846 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197346:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1846 expref: 17 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197350:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8980 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896192:0@lo:104: 00000100:00100000:2.0:1717018880.197360:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018880.197371:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1838 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197374:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1717018880.197376:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1838 expref: 17 pid: 8249 timeout: 2013 lvb_type: 0 00000100:00100000:3.0:1717018880.197377:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092acaac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+5:27303:x1800422819895936:12345-0@lo:104: Request processed in 40us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018880.197381:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896256:0@lo:104: 00000100:00100000:3.0:1717018880.197383:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1717018880.197391:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018880.197393:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896128 00000100:00100000:3.0:1717018880.197399:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896192 00000100:00100000:3.0:1717018880.197403:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896256 00010000:00010000:2.0:1717018880.197404:0:27303:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c182a expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197409:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00010000:00010000:2.0:1717018880.197409:0:27303:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c182a expref: 17 pid: 8249 timeout: 2013 lvb_type: 0 00000100:00100000:3.0:1717018880.197411:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+7:27303:x1800422819896000:12345-0@lo:104: 00000100:00100000:2.0:1717018880.197414:0:27303:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896320:0@lo:104: 00000100:00100000:2.0:1717018880.197425:0:27303:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018880.197430:0:27303:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800921556c0 going to sleep for 6 seconds 00010000:00010000:3.0:1717018880.197436:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018880.197439:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+7:27303:x1800422819896000:12345-0@lo:104: Request processed in 28us (222us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018880.197442:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1717018880.197444:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00010000:00010000:2.0:1717018880.197445:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197464:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e2ac0 already unused, calling callback (ffffffffa02815c0) 00000100:00100000:3.0:1717018880.197465:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896320 10000000:00010000:2.0:1717018880.197465:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197471:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00010000:00010000:2.0:1717018880.197471:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197474:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880081483850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+7:27303:x1800422819896064:12345-0@lo:104: 10000000:00010000:2.0:1717018880.197476:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018880.197480:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018880.197494:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1717018880.197496:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197497:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880081483850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+7:27303:x1800422819896064:12345-0@lo:104: Request processed in 23us (221us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018880.197500:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1717018880.197501:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00010000:00010000:2.0:1717018880.197511:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197515:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e2ac0/0x81e56358f42c187e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1885 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197530:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00010000:00010000:2.0:1717018880.197531:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1717018880.197532:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092acaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+6:27303:x1800422819896128:12345-0@lo:104: 00010000:00010000:2.0:1717018880.197532:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197536:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d3600 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018880.197537:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197541:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018880.197545:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018880.197548:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018880.197549:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018880.197551:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092acaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+6:27303:x1800422819896128:12345-0@lo:104: Request processed in 19us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018880.197555:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00010000:00010000:2.0:1717018880.197556:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197559:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018880.197562:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197566:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00010000:00010000:2.0:1717018880.197566:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c1870 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1877 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197568:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+5:27303:x1800422819896192:12345-0@lo:104: 00010000:00010000:2.0:1717018880.197574:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018880.197576:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197579:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0d80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018880.197581:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197585:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018880.197588:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+5:27303:x1800422819896192:12345-0@lo:104: Request processed in 19us (228us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018880.197588:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197592:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 10000000:00010000:2.0:1717018880.197592:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018880.197595:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1717018880.197597:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1717018880.197599:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+4:27303:x1800422819896256:12345-0@lo:104: 00010000:00010000:2.0:1717018880.197602:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197606:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018880.197613:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:2.0:1717018880.197613:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197615:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+4:27303:x1800422819896256:12345-0@lo:104: Request processed in 15us (224us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018880.197617:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c1862 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1869 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197619:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00010000:00010000:2.0:1717018880.197623:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1717018880.197624:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018880.197625:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1717018880.197628:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+3:27303:x1800422819896320:12345-0@lo:104: 00010000:00010000:2.0:1717018880.197628:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1f80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018880.197629:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197633:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018880.197636:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197640:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 10000000:01000000:2.0:1717018880.197640:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1717018880.197643:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+3:27303:x1800422819896320:12345-0@lo:104: Request processed in 15us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018880.197646:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00010000:00010000:2.0:1717018880.197651:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197655:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1717018880.197655:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018880.197657:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197658:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197661:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d3840 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:2.0:1717018880.197662:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c1854 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c185b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018880.197663:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197667:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197669:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1717018880.197670:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197673:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79cd80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018880.197674:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018880.197674:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018880.197678:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018880.197678:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717018880.197681:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018880.197684:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018880.197685:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197688:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018880.197689:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197691:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197693:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018880.197694:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c1846 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c184d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197695:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197698:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79cd80/0x81e56358f42c1838 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c183f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197702:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1717018880.197703:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197706:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d3180 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:2.0:1717018880.197706:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1717018880.197707:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.197707:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018880.197708:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018880.197711:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018880.197714:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018880.197716:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896384:0@lo:103:ldlm_bl_05.0 10000000:01000000:3.0:1717018880.197718:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018880.197723:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197733:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1717018880.197734:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1717018880.197736:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.197740:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c182a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1831 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018880.197744:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896640:0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717018880.197748:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018880.197749:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018880.197750:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018880.197754:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018880.197755:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1717018880.197757:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018880.197763:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819896576:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018880.197765:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1717018880.197769:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896448:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018880.197777:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018880.197787:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896384 00000100:00100000:3.0:1717018880.197790:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1717018880.197793:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819896512:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018880.197796:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c187e expref: 18 pid: 8250 timeout: 2013 lvb_type: 0 00000100:00100000:3.0:1717018880.197805:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018880.197809:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896640 00000100:00100000:3.0:1717018880.197813:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819896768:0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018880.197814:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1846 expref: 19 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197823:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896576 00000100:00100000:3.0:1717018880.197841:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018880.197844:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1854 expref: 20 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197853:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896512 00010000:00010000:2.0:1717018880.197857:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1862 expref: 21 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:3.0:1717018880.197859:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896768 00010000:00010000:3.0:1717018880.197864:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c182a expref: 22 pid: 8249 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.197865:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75366 00000100:00100000:2.0:1717018880.197867:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+22:2852:x1800422819896384:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018880.197872:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75367 00010000:00010000:2.0:1717018880.197873:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1717018880.197874:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092968980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+22:2852:x1800422819896640:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717018880.197878:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018880.197879:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c187e expref: 22 pid: 8250 timeout: 2013 lvb_type: 0 00010000:00010000:3.0:1717018880.197880:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1846 expref: 22 pid: 8248 timeout: 2013 lvb_type: 0 00010000:00010000:2.0:1717018880.197885:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c187e expref: 22 pid: 8250 timeout: 2013 lvb_type: 0 00010000:00010000:3.0:1717018880.197894:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1846 expref: 22 pid: 8248 timeout: 2013 lvb_type: 0 00010000:00010000:1.0:1717018880.197924:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018880.197931:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018880.197948:0:6617:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75368 00000100:00100000:0.0:1717018880.197951:0:6617:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+22:2855:x1800422819896576:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:0.0:1717018880.197956:0:6617:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018880.197958:0:6617:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1854 expref: 22 pid: 8248 timeout: 2013 lvb_type: 0 00010000:00010000:3.0:1717018880.198530:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717018880.198538:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018880.198551:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092968980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+22:2852:x1800422819896640:12345-0@lo:103:ldlm_bl_03.0 Request processed in 675us (794us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018880.198553:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714b440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+22:2852:x1800422819896384:12345-0@lo:103:ldlm_bl_05.0 Request processed in 685us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018880.198556:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75367 00000100:00100000:2.0:1717018880.198557:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75366 00000100:00100000:3.0:1717018880.198569:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75369 00000100:00100000:3.0:1717018880.198571:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869697c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819896512:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018880.198571:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75370 00000100:00100000:2.0:1717018880.198573:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819896768:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717018880.198576:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018880.198577:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018880.198579:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1862 expref: 20 pid: 8248 timeout: 2013 lvb_type: 0 00010000:00010000:2.0:1717018880.198579:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c182a expref: 20 pid: 8249 timeout: 2013 lvb_type: 0 00010000:00010000:2.0:1717018880.198584:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c182a expref: 20 pid: 8249 timeout: 2013 lvb_type: 0 00010000:00010000:2.0:1717018880.198590:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1717018880.198601:0:6617:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1854 expref: 20 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.198605:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819896768:12345-0@lo:103:ldlm_bl_03.0 Request processed in 32us (781us total) trans 0 rc 0/0 00010000:00010000:0.0:1717018880.198608:0:6617:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018880.198609:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75370 00000100:00100000:0.0:1717018880.198623:0:6617:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+19:2855:x1800422819896576:12345-0@lo:103:ldlm_bl_05.0 Request processed in 672us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018880.198628:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018880.198628:0:6617:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75368 00000100:00100000:2.0:1717018880.198637:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801371497c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896704:0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018880.198637:0:6617:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896448 00010000:00010000:0.0:1717018880.198643:0:6617:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1870 expref: 19 pid: 8250 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.198650:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018880.198653:0:6617:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896704 00010000:00010000:0.0:1717018880.198658:0:6617:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1838 expref: 20 pid: 8249 timeout: 2013 lvb_type: 0 00000100:00100000:2.0:1717018880.198664:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896384:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018880.198670:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880086968e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896640:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717018880.198789:0:6618:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75371 00000100:00100000:2.0:1717018880.198792:0:6618:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+20:2852:x1800422819896448:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018880.198792:0:6617:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75372 00010000:00010000:2.0:1717018880.198797:0:6618:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1717018880.198799:0:6617:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800929697c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+20:2852:x1800422819896704:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018880.198800:0:6618:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1870 expref: 20 pid: 8250 timeout: 2013 lvb_type: 0 00010000:00010000:0.0:1717018880.198803:0:6617:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018880.198805:0:6617:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1838 expref: 20 pid: 8249 timeout: 2013 lvb_type: 0 00010000:00010000:2.0:1717018880.198904:0:6618:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1870 expref: 20 pid: 8250 timeout: 2013 lvb_type: 0 00010000:00010000:0.0:1717018880.198927:0:6617:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1838 expref: 20 pid: 8249 timeout: 2013 lvb_type: 0 00010000:00010000:0.0:1717018880.198934:0:6617:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1717018880.198955:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1862 expref: 20 pid: 8248 timeout: 2013 lvb_type: 0 00010000:00010000:3.0:1717018880.198962:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717018880.199017:0:6618:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199023:0:6618:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199033:0:6618:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199037:0:6618:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199041:0:6618:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199045:0:6618:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199048:0:6618:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0900 already unused, calling callback (ffffffffa0811190) 00010000:00010000:2.0:1717018880.199050:0:6618:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199054:0:6618:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199064:0:6618:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.199070:0:6618:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018880.199106:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869697c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819896512:12345-0@lo:103:ldlm_bl_05.0 Request processed in 533us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018880.199111:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75369 00000100:00100000:3.0:1717018880.199139:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819896512:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018880.199144:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819896768:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1717018880.199148:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819896576:0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018880.199220:0:6617:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800929697c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819896704:12345-0@lo:103:ldlm_bl_05.0 Request processed in 420us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018880.199224:0:6617:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75372 00000100:00100000:2.0:1717018880.199234:0:6618:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dfa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819896448:12345-0@lo:103:ldlm_bl_05.0 Request processed in 442us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018880.199238:0:6618:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75371 00000100:00100000:3.0:1717018880.199321:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896448:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018880.199327:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801371497c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819896704:0@lo:103:ldlm_bl_05.0 00010000:00010000:0.0:1717018880.199349:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1885 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c187e expref: 17 pid: 8250 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199356:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819895936:0@lo:104: 00010000:00010000:0.0:1717018880.199362:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e3600/0x81e56358f42c1877 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1870 expref: 16 pid: 8250 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199367:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896000:0@lo:104: 00010000:00010000:0.0:1717018880.199372:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1f600/0x81e56358f42c1869 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1862 expref: 15 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199377:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acdf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896064:0@lo:104: 00010000:00010000:0.0:1717018880.199382:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e2f40/0x81e56358f42c185b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1854 expref: 14 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199387:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac84c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896128:0@lo:104: 00010000:00010000:0.0:1717018880.199392:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e3a80/0x81e56358f42c184d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1846 expref: 13 pid: 8248 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199402:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8980 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896192:0@lo:104: 00010000:00010000:0.0:1717018880.199407:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e3180/0x81e56358f42c183f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1838 expref: 12 pid: 8249 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199410:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896256:0@lo:104: 00010000:00010000:0.0:1717018880.199413:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1680/0x81e56358f42c1831 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c182a expref: 11 pid: 8249 timeout: 2013 lvb_type: 0 00000100:00100000:0.0:1717018880.199415:0:27303:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:27303:1800422819896320:0@lo:104: 00010000:00010000:0.0:1717018880.199432:0:27303:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.199435:0:27303:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.199437:0:27303:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018880.199440:0:27303:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d0900/0x81e56358f42c188c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27303 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018880.393974:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018880.394139:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668288 00000100:00100000:3.0:1717018880.394620:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1033 00000100:00100000:3.0:1717018880.394627:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+7:4633:x1800422838668288:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018880.394652:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018880.394672:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36769 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.394700:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.394707:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018880.394714:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1fa80, rc 0) 00000100:00100000:3.0:1717018880.394771:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838668288:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 145us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018880.394778:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1033 00000100:00100000:3.0:1717018880.397870:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018880.398092:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668352 00000100:00100000:0.0:1717018880.398127:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1034 00000100:00100000:0.0:1717018880.398132:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838668352:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.398500:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838668352:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 128us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018880.398601:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1034 00000100:00100000:0.0:1717018880.399497:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018880.399556:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668416 00000100:00100000:2.0:1717018880.399588:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1035 00000100:00100000:2.0:1717018880.399592:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838668416:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018880.399780:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838668416:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 187us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018880.399786:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1035 00000100:00100000:2.0:1717018880.402249:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018880.402328:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668480 00000100:00100000:0.0:1717018880.402371:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1036 00000100:00100000:0.0:1717018880.402375:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:22743:x1800422838668480:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1717018880.402776:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:22743:x1800422838668480:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 400us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018880.402782:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1036 00000100:00100000:3.0:1717018880.404211:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018880.404281:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668544 00000100:00100000:0.0:1717018880.404304:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1037 00000100:00100000:0.0:1717018880.404308:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:22743:x1800422838668544:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:0.0:1717018880.404768:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:22743:x1800422838668544:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 458us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018880.404774:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1037 00000100:00100000:0.0:1717018880.406429:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018880.406623:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668608 00000100:00100000:2.0:1717018880.406663:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1038 00000100:00100000:2.0:1717018880.406666:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838668608:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018880.406676:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018880.406688:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36770 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.406708:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 9 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.406714:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 9 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018880.406732:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d1f80, rc 0) 00000100:00100000:2.0:1717018880.406776:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838668608:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 109us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018880.406782:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1038 00000100:00100000:2.0:1717018880.408360:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018880.408610:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668672 00000100:00100000:0.0:1717018880.408642:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1039 00000100:00100000:0.0:1717018880.408646:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838668672:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018880.408742:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838668672:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 95us (385us total) trans 0 rc -2/-2 00000100:00100000:0.0:1717018880.408747:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1039 00010000:00010000:0.0:1717018880.416133:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717018881.112018:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717018881.112024:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 104 10000000:01000000:1.0:1717018881.112028:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717018881.112060:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.112068:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.112074:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018881.112092:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819896832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.112145:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.112205:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.112258:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896832 00000100:00100000:0.0:1717018881.113760:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1717018881.113767:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819896832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018881.113777:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018881.113800:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18a1 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.113817:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 12 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.113838:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 12 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.113844:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1680, rc 0) 00000100:00100000:0.0:1717018881.113892:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819896832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (1747us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.113899:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:1.0:1717018881.114735:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819896832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018881.114749:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.114756:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018881.114841:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819896896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.114869:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.114892:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.114943:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896896 00000100:00100000:3.0:1717018881.114973:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1717018881.114976:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819896896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.115068:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819896896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.115074:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1717018881.115303:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819896896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.115325:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819896960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.115354:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.115371:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.115410:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819896960 00000100:00100000:3.0:1717018881.115436:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1717018881.115452:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819896960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.115606:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819896960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 154us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.115611:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1717018881.115841:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819896960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018881.116144:0:27307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092968980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27307:1800422819897024:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018881.116169:0:27307:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018881.116185:0:27307:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a69c9600 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.116331:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897024 00000100:00100000:0.0:1717018881.116347:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:0.0:1717018881.116349:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:27307:x1800422819897024:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018881.116591:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:27307:x1800422819897024:12345-0@lo:502:llog_process_th.0 Request processed in 240us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.116596:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1717018881.116758:0:27307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092968980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27307:1800422819897024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.116794:0:27307:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27307:1800422819897088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.116819:0:27307:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018881.116847:0:27307:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013480e480 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.116925:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897088 00000100:00100000:2.0:1717018881.116949:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1717018881.116952:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27307:x1800422819897088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018881.117068:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:27307:x1800422819897088:12345-0@lo:502:llog_process_th.0 Request processed in 115us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.117073:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1717018881.117357:0:27307:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27307:1800422819897088:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018881.117375:0:27307:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 107 count 105 00000020:01000000:1.0:1717018881.117535:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 104-106 (rc=0) 10000000:01000000:1.0:1717018881.117555:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1717018881.117559:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.117568:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018881.117576:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1717018881.117578:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 99 10000000:01000000:1.0:1717018881.117580:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1717018881.117593:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.117598:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.117604:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018881.117622:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.117642:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.117650:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.117711:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897152 00000100:00100000:2.0:1717018881.117725:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1717018881.117727:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819897152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018881.117732:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018881.117742:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18af expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.117756:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18af expref: 13 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.117762:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18af expref: 13 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.117775:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0d80, rc 0) 00000100:00100000:2.0:1717018881.117793:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819897152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 65us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.117797:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:1.0:1717018881.117907:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018881.117915:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.117920:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018881.117948:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.117964:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.117971:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.118015:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897216 00000100:00100000:0.0:1717018881.118027:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1717018881.118029:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819897216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.118200:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819897216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 169us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.118205:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:1.0:1717018881.118238:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.118255:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.118280:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.118295:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.118334:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897280 00000100:00100000:0.0:1717018881.118353:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1717018881.118356:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819897280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.118514:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819897280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.118518:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:1.0:1717018881.118563:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018881.118989:0:27308:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27308:1800422819897344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018881.119016:0:27308:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018881.119033:0:27308:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a695f00 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.119118:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897344 00000100:00100000:0.0:1717018881.119138:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1717018881.119141:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:27308:x1800422819897344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018881.119430:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:27308:x1800422819897344:12345-0@lo:502:llog_process_th.0 Request processed in 287us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.119435:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:3.0:1717018881.119535:0:27308:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969c80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27308:1800422819897344:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717018881.119553:0:27308:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717018881.119558:0:27308:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018881.119560:0:27308:0:(obd_config.c:1460:class_process_config()) marker 67 (0x1) lustre-MDT0000-m del lustre.test_22c 00000020:00000080:3.0:1717018881.119564:0:27308:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1717018881.122405:0:27308:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27308:1800422819897408:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.122480:0:27308:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018881.122513:0:27308:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a69c9600 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.123501:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897408 00000100:00100000:2.0:1717018881.123537:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1717018881.123540:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27308:x1800422819897408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018881.123744:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:27308:x1800422819897408:12345-0@lo:502:llog_process_th.0 Request processed in 202us (1263us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.123749:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:3.0:1717018881.123773:0:27308:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27308:1800422819897408:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717018881.123796:0:27308:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1717018881.123800:0:27308:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018881.123802:0:27308:0:(obd_config.c:1460:class_process_config()) marker 67 (0x2) lustre-MDT0000-m del lustre.test_22c 00000040:00080000:3.0:1717018881.123805:0:27308:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 102 count 100 00000020:01000000:3.0:1717018881.124255:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 99-101 (rc=0) 10000000:01000000:3.0:1717018881.124281:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1717018881.124291:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.124299:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018881.124306:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1717018881.124309:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 104 10000000:01000000:3.0:1717018881.124310:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1717018881.124326:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.124331:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.124337:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018881.124347:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.124369:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018881.124384:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60a9e40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.124423:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897472 00000100:00100000:0.0:1717018881.124477:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1717018881.124482:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819897472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018881.124494:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018881.124510:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18bd expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.124581:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18bd expref: 14 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.124589:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18bd expref: 14 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.124596:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e3180, rc 0) 00000100:00100000:0.0:1717018881.124657:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819897472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.124663:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:3.0:1717018881.124803:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018881.124816:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.124823:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018881.124894:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.124917:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018881.124968:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60a9e40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.125010:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897536 00000100:00100000:0.0:1717018881.125548:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1717018881.125553:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819897536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.125661:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819897536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.125676:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00000100:00100000:3.0:1717018881.125691:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.125715:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.125750:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.125773:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897600 00000100:00100000:0.0:1717018881.125794:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1717018881.125797:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819897600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.125856:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60a9e40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.125989:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819897600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.125994:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:3.0:1717018881.126090:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.126214:0:27309:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27309:1800422819897664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.126245:0:27309:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018881.126254:0:27309:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a69c9600 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.126258:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897664 00000100:00100000:0.0:1717018881.126285:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1053 00000100:00100000:0.0:1717018881.126288:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27309:x1800422819897664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018881.126674:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27309:x1800422819897664:12345-0@lo:502:llog_process_th.0 Request processed in 385us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.126679:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1053 00000100:00100000:3.0:1717018881.126782:0:27309:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27309:1800422819897664:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.126820:0:27309:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27309:1800422819897728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.126865:0:27309:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018881.126883:0:27309:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60a9e40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.126905:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897728 00000100:00100000:0.0:1717018881.126945:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:0.0:1717018881.126948:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27309:x1800422819897728:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018881.127058:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:27309:x1800422819897728:12345-0@lo:502:llog_process_th.0 Request processed in 109us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.127063:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1717018881.127075:0:27309:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27309:1800422819897728:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018881.127093:0:27309:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 107 count 105 00000020:01000000:0.0:1717018881.127126:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 104-106 (rc=0) 10000000:01000000:0.0:1717018881.127145:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018881.127152:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.127724:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018881.127730:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1717018881.127731:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1717018881.127733:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1717018881.127752:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.127755:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.127760:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.127772:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.127794:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.127816:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099af9e40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.127897:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897792 00000100:00100000:2.0:1717018881.127924:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1055 00000100:00100000:2.0:1717018881.127927:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819897792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018881.127932:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018881.127942:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18cb expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.127954:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18cb expref: 15 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.127960:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18cb expref: 15 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.127974:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d3600, rc 0) 00000100:00100000:2.0:1717018881.127994:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819897792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 67us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.127998:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1055 00000100:00100000:0.0:1717018881.128091:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018881.128101:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.128107:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.128138:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.128154:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.128166:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099af9e40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.128211:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897856 00000100:00100000:3.0:1717018881.128226:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1717018881.128229:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819897856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.128304:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819897856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.128309:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:0.0:1717018881.128382:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.128398:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897920:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.128427:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.128434:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099af9e40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.128488:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897920 00000100:00100000:2.0:1717018881.128501:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1057 00000100:00100000:2.0:1717018881.128503:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819897920:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018881.128631:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819897920:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.128636:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1057 00000100:00100000:0.0:1717018881.128719:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897920:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1717018881.129393:0:27310:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:0.0:1717018881.130182:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1717018881.130204:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1717018881.130208:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.130215:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018881.130222:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717018881.130223:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 104 10000000:01000000:0.0:1717018881.130226:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717018881.130241:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.130246:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.130252:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.130264:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.130293:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.130317:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349ccb40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.130377:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819897984 00000100:00100000:3.0:1717018881.130414:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1058 00000100:00100000:3.0:1717018881.130476:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819897984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018881.130489:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018881.130498:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18d9 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.130536:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.130541:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.130555:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1fcc0, rc 0) 00000100:00100000:3.0:1717018881.130594:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819897984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 175us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.130598:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1058 00000100:00100000:0.0:1717018881.130608:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819897984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018881.130618:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.130624:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.130651:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.130668:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.130686:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349ccb40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.131066:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898048 00000100:00100000:3.0:1717018881.131161:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1059 00000100:00100000:3.0:1717018881.131164:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819898048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.131256:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819898048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.131261:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1059 00000100:00100000:0.0:1717018881.131625:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.131647:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.131677:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.131889:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349ccb40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.132036:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898112 00000100:00100000:2.0:1717018881.132095:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1060 00000100:00100000:2.0:1717018881.132099:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819898112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018881.132256:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819898112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.132369:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018881.132558:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1060 00000100:00100000:1.0:1717018881.132932:0:27311:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27311:1800422819898176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018881.132962:0:27311:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.133239:0:27311:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.133294:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898176 00000100:00100000:3.0:1717018881.133319:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1061 00000100:00100000:3.0:1717018881.133323:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:27311:x1800422819898176:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018881.133602:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:27311:x1800422819898176:12345-0@lo:502:llog_process_th.0 Request processed in 278us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.133608:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1061 00000100:00100000:1.0:1717018881.133726:0:27311:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27311:1800422819898176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018881.133761:0:27311:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27311:1800422819898240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018881.133786:0:27311:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.133804:0:27311:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752cc0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018881.133844:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898240 00000100:00100000:0.0:1717018881.133860:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1062 00000100:00100000:0.0:1717018881.133862:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27311:x1800422819898240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018881.133980:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:27311:x1800422819898240:12345-0@lo:502:llog_process_th.0 Request processed in 116us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018881.133984:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1062 00000100:00100000:1.0:1717018881.134045:0:27311:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:27311:1800422819898240:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1717018881.134061:0:27311:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 107 count 105 00000020:01000000:0.0:1717018881.134190:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 104-106 (rc=0) 10000000:01000000:0.0:1717018881.134208:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1717018881.134213:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.134229:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018881.134235:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1717018881.134237:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1717018881.134239:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1717018881.134253:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.134258:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.134265:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.134274:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.134292:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.134545:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cce40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.134601:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898304 00000100:00100000:3.0:1717018881.134633:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1063 00000100:00100000:3.0:1717018881.134636:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819898304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018881.134642:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018881.134652:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18e7 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.134665:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.134676:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.134681:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1f3c0, rc 0) 00000100:00100000:3.0:1717018881.134707:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819898304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018881.134711:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1063 00000100:00100000:0.0:1717018881.134807:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018881.134816:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.134821:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.134869:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.134884:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.134890:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cce40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.134925:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898368 00000100:00100000:2.0:1717018881.134938:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1064 00000100:00100000:2.0:1717018881.134940:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819898368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018881.135007:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819898368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.135012:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1064 00000100:00100000:0.0:1717018881.135121:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.135139:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.135159:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.135164:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cce40 going to sleep for 6 seconds 00000100:00100000:1.0:1717018881.135200:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898432 00000100:00100000:1.0:1717018881.135211:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:1.0:1717018881.135214:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819898432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.135333:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819898432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018881.135338:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1717018881.135453:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898432:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1717018881.136012:0:27312:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:0.0:1717018881.136150:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1717018881.136166:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1717018881.136170:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.136176:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018881.136182:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018881.136184:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:0.0:1717018881.136186:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018881.136197:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.136201:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018881.136206:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018881.136215:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018881.136236:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018881.136250:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cce40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018881.136300:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898496 00000100:00100000:2.0:1717018881.136575:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1717018881.136579:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819898496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018881.136591:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018881.136600:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c18f5 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.136612:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 18 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.136618:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 18 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018881.136623:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d1440, rc 0) 00000100:00100000:2.0:1717018881.136651:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819898496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018881.136655:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:1.0:1717018881.136944:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018881.136953:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.136958:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018881.136987:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018881.137003:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018881.137351:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e7526c0 going to sleep for 6 seconds 00000100:00100000:3.0:1717018881.137410:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898560 00000100:00100000:3.0:1717018881.137434:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:3.0:1717018881.137438:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819898560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018881.137531:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819898560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (527us total) trans 0 rc -2/-2 00000100:00100000:3.0:1717018881.137536:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:1.0:1717018881.137625:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819898560:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1717018881.137648:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1717018881.137651:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018881.137664:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018881.419161:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018882.419970:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018882.556770:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1717018882.556793:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819898624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1717018882.556870:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018882.557482:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898624 00000100:00100000:3.0:1717018882.557528:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 598 00000100:00100000:3.0:1717018882.557533:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819898624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1717018882.557859:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1717018882.557931:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819898624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 397us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018882.557937:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 598 00000100:00100000:1.0:1717018882.557968:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696f200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819898624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1717018882.978976:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018882.979224:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668800 00000100:00100000:3.0:1717018882.979231:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018882.979261:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018882.979264:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668928 00000100:00100000:0.0:1717018882.979270:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 701 00000100:00100000:0.0:1717018882.979283:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+63:1835:x1800422838668800:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018882.979285:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018882.979286:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 990 00000100:00100000:2.0:1717018882.979288:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1835:x1800422838668928:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018882.979307:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668736 00010000:00000080:0.0:1717018882.979308:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008696f200 x1800422838668800/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:234/0 lens 224/224 e 0 to 0 dl 1717018969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1717018882.979327:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1068 00000100:00100000:3.0:1717018882.979331:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838668736:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018882.979338:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696d580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1835:x1800422838668928:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 49us (108us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018882.979343:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 990 00000100:00100000:2.0:1717018882.979351:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668864 00000100:00100000:2.0:1717018882.979359:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 991 00000100:00100000:2.0:1717018882.979361:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+549:1835:x1800422838668864:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018882.979411:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696f200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+63:1835:x1800422838668800:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 128us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018882.979417:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 701 00000100:00100000:3.0:1717018882.979459:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838668736:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 126us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018882.979462:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+549:1835:x1800422838668864:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 99us (177us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018882.979465:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1068 00000100:00100000:2.0:1717018882.979468:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 991 00010000:00010000:3.0:1717018883.422017:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018884.044007:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819898688:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018884.044007:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2853:1800422819898752:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1717018884.044007:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2854:1800422819898816:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018884.044057:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018884.044057:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018884.044058:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819898880:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1717018884.044081:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018884.044086:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b8297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819898944:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018884.044087:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2853:1800422819899008:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018884.044104:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018884.044104:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018884.044109:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898752 00000100:00100000:3.0:1717018884.044124:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898880 00000100:00100000:2.0:1717018884.044124:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898688 00000100:00100000:0.0:1717018884.044132:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899008 00000100:00100000:2.0:1717018884.044141:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1717018884.044142:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1717018884.044143:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898944 00000100:00100000:2.0:1717018884.044145:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819898688:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1717018884.044145:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2853:x1800422819898752:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018884.044157:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00010000:00000080:0.0:1717018884.044158:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009296a140 x1800422819898752/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:236/0 lens 224/224 e 0 to 0 dl 1717018971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:3.0:1717018884.044160:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef42ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819898880:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018884.044174:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819898688:12345-0@lo:400:kworker/u8:1.0 Request processed in 29us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018884.044178:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:0.0:1717018884.044180:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296a140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2853:x1800422819898752:12345-0@lo:400:kworker/u8:1.0 Request processed in 35us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018884.044185:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 702 00000100:00100000:3.0:1717018884.044189:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef42ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819898880:12345-0@lo:400:kworker/u8:1.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018884.044193:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1717018884.044193:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 703 00000100:00100000:0.0:1717018884.044195:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092968e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2853:x1800422819899008:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1717018884.044200:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092968e40 x1800422819899008/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:236/0 lens 224/224 e 0 to 0 dl 1717018971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1717018884.044203:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1717018884.044206:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800869697c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819898944:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1717018884.044213:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092968e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2853:x1800422819899008:12345-0@lo:400:kworker/u8:1.0 Request processed in 17us (109us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018884.044222:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 703 00000100:00100000:3.0:1717018884.044228:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819898688:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018884.044229:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800869697c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819898944:12345-0@lo:400:kworker/u8:1.0 Request processed in 23us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018884.044233:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1717018884.044245:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82af80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819898880:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018884.044251:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2853:1800422819899008:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1717018884.044254:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b8297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819898944:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1717018884.044257:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2853:1800422819898752:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1717018884.044258:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018884.044271:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819898816 00000100:00100000:0.0:1717018884.044281:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 704 00000100:00100000:0.0:1717018884.044283:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef42f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2854:x1800422819898816:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1717018884.044289:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88007ef42f80 x1800422819898816/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:236/0 lens 224/224 e 0 to 0 dl 1717018971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1717018884.044319:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef42f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2854:x1800422819898816:12345-0@lo:400:kworker/u8:1.0 Request processed in 35us (61us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018884.044322:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 704 00000100:00100000:2.0:1717018884.044392:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2854:1800422819898816:0@lo:400:kworker/u8:1.0 00010000:00010000:1.0:1717018884.424168:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:3.0:1717018884.523290:0:27815:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:3.0:1717018884.523296:0:27815:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22d: out of/low on space + failed to repeat + forced extension ========================================================== 17:41:24 (1717018884) 00000100:00100000:0.0:1717018884.555634:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018884.555702:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838668992 00000100:00100000:1.0:1717018884.555758:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 349 00000100:00100000:1.0:1717018884.555765:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:22895:x1800422838668992:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1717018884.555785:0:8254:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018884.555808:0:8254:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79d8c0/0x81e56358f42c1903 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36777 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.555885:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.555897:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.555907:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.555918:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.555923:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.555935:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556025:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556030:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556035:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556040:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79ed00 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018884.556043:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556048:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556058:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:1.0:1717018884.556060:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018884.556063:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556067:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79ed00/0x81e56358f42c190a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556076:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556090:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556094:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556098:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79fcc0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018884.556100:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556104:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556110:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9516acfe (ffff88012d404300) 00010000:00010000:1.0:1717018884.556112:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018884.556113:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556117:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fcc0/0x81e56358f42c1911 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556154:0:8254:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79d8c0/0x81e56358f42c1903 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36777 expref: 64 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556161:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79d8c0/0x81e56358f42c1903 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36777 expref: 64 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.556168:0:8254:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79d8c0, rc 0) 00010000:00000080:1.0:1717018884.556178:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88007ef404c0 x1800422838668992/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:236/0 lens 584/640 e 0 to 0 dl 1717018971 ref 1 fl Interpret:/0/0 rc 301/0 job:'bash.0' 00000100:00100000:1.0:1717018884.556244:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef404c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:22895:x1800422838668992:12345-192.168.203.26@tcp:101:bash.0 Request processed in 480us (617us total) trans 0 rc 301/301 00000100:00100000:1.0:1717018884.556251:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 349 00000100:00100000:0.0:1717018884.557630:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018884.557695:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669056 00000100:00100000:1.0:1717018884.557741:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 350 00000100:00100000:1.0:1717018884.557746:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef41c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:22895:x1800422838669056:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1717018884.557758:0:8254:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018884.557771:0:8254:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e640/0x81e56358f42c1918 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3677e expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.557815:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79f840/0x81e56358f42c191f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.557845:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79f840/0x81e56358f42c191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.557854:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79f840/0x81e56358f42c191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1717018884.557906:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:1.0:1717018884.557909:0:8254:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 48 stripe count 1 MDT count 1 00000004:00010000:1.0:1717018884.557922:0:8254:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79f840/0x81e56358f42c191f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.557939:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e640/0x81e56358f42c1918 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3677e expref: 65 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.557960:0:8254:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79f840/0x81e56358f42c191f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3677e expref: 64 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.557966:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:1.0:1717018884.557968:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1717018884.557970:0:8254:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79f840, rc 0) 00010000:00000080:1.0:1717018884.557973:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88007ef41c80 x1800422838669056/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:236/0 lens 576/688 e 0 to 0 dl 1717018971 ref 1 fl Interpret:/0/0 rc 0/0 job:'bash.0' 00000100:00100000:1.0:1717018884.558014:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef41c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+64:22895:x1800422838669056:12345-192.168.203.26@tcp:101:bash.0 Request processed in 267us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018884.558019:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 350 00000100:00100000:2.0:1717018884.564282:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018884.564359:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669184 00000100:00100000:1.0:1717018884.564410:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 351 00000100:00100000:1.0:1717018884.564416:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+64:23055:x1800422838669184:12345-192.168.203.26@tcp:36:mkdir.0 00010000:00010000:1.0:1717018884.564475:0:8254:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018884.564500:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79f840/0x81e56358f42c191f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3677e expref: 64 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.564515:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:1.0:1717018884.564520:0:8254:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717018884.564621:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.564634:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.564654:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.564666:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.564671:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.564675:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1717018884.566031:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cf0:0x0]: returning size 512 00010000:00010000:1.0:1717018884.566040:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.566047:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.566053:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.566058:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79cd80 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018884.566061:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.566067:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.566077:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:1.0:1717018884.566082:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018884.566085:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.566090:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cd80/0x81e56358f42c1926 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1717018884.566099:0:8254:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009296cc00 reply state ffff8801338ab800 transno 12884902031 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00000080:1.0:1717018884.566131:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009296cc00 x1800422838669184/t12884902031(0) o36->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:236/0 lens 512/448 e 0 to 0 dl 1717018971 ref 1 fl Interpret:/0/0 rc 0/0 job:'mkdir.0' 00000100:00100000:1.0:1717018884.566200:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+65:23055:x1800422838669184:12345-192.168.203.26@tcp:36:mkdir.0 Request processed in 1783us (1926us total) trans 12884902031 rc 0/0 00000100:00100000:1.0:1717018884.566209:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 351 00010000:00010000:1.0:1717018884.568509:0:2839:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.568523:0:2839:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.568528:0:2839:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.568534:0:2839:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79e880 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018884.568538:0:2839:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.568543:0:2839:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.568562:0:2839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9516acfe (ffff88012d404b00) 00010000:00010000:1.0:1717018884.568565:0:2839:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018884.568567:0:2839:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018884.568571:0:2839:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e880/0x81e56358f42c192d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018885.426601:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018886.428184:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1717018886.734928:0:8305:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902031 is committed 00010000:00010000:3.0:1717018887.430093:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717018887.564087:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819899072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1717018887.564147:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018887.564215:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899072 00000100:00100000:3.0:1717018887.564256:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 599 00000100:00100000:3.0:1717018887.564260:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819899072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1717018887.564293:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1717018887.564334:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296c740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819899072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018887.564340:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 599 00000100:00100000:2.0:1717018887.564383:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819899072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717018887.983298:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018887.983335:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018887.983433:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669440 00000100:00100000:1.0:1717018887.983477:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669312 00000100:00100000:3.0:1717018887.983526:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 994 00000100:00100000:1.0:1717018887.983528:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 705 00000100:00100000:3.0:1717018887.983531:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef44280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+519:1833:x1800422838669440:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018887.983533:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef43900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:1833:x1800422838669312:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00010000:00000080:1.0:1717018887.983563:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88007ef43900 x1800422838669312/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:239/0 lens 224/224 e 0 to 0 dl 1717018974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:0.0:1717018887.983577:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018887.983585:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef44280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+519:1833:x1800422838669440:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 54us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018887.983601:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef43900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:1833:x1800422838669312:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 68us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018887.983608:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 705 00000100:00100000:2.0:1717018887.983624:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669248 00000100:00100000:2.0:1717018887.983647:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1070 00000100:00100000:2.0:1717018887.983659:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:1834:x1800422838669248:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018887.983670:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018887.983687:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 994 00000100:00100000:0.0:1717018887.983687:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669376 00000100:00100000:3.0:1717018887.983702:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 995 00000100:00100000:3.0:1717018887.983705:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef44740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1834:x1800422838669376:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717018887.983725:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef44740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1834:x1800422838669376:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 19us (56us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018887.983730:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 995 00000100:00100000:2.0:1717018887.983816:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:1834:x1800422838669248:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 156us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018887.983821:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1070 00010000:00010000:3.0:1717018888.432008:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018889.052324:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819899264:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018889.052331:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819899200:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018889.052475:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819899136:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018889.052620:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819899328:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018889.053014:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018889.053082:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018889.053122:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b8297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819899456:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018889.053125:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018889.053147:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018889.053151:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899264 00000100:00100000:2.0:1717018889.053153:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899328 00000100:00100000:1.0:1717018889.053183:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899200 00000100:00100000:0.0:1717018889.053214:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018889.053227:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819899392:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018889.053243:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018889.053278:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1717018889.053283:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819899328:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018889.053317:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819899328:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018889.053322:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1717018889.053335:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899392 00000100:00100000:2.0:1717018889.053346:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1717018889.053348:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819899392:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018889.053362:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef45a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819899392:12345-0@lo:400:kworker/u8:0.0 Request processed in 14us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018889.053366:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:1.0:1717018889.053428:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899456 00000100:00100000:0.0:1717018889.053429:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 706 00000100:00100000:0.0:1717018889.053432:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819899264:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018889.053441:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 707 00000100:00100000:1.0:1717018889.053444:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880086968e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819899200:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:0.0:1717018889.053447:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008b82af80 x1800422819899264/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:241/0 lens 224/224 e 0 to 0 dl 1717018976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00010000:00000080:1.0:1717018889.053452:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880086968e40 x1800422819899200/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:241/0 lens 224/224 e 0 to 0 dl 1717018976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:0.0:1717018889.053474:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82af80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819899264:12345-0@lo:400:kworker/u8:0.0 Request processed in 41us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018889.053479:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 706 00000100:00100000:1.0:1717018889.053482:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880086968e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819899200:12345-0@lo:400:kworker/u8:0.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018889.053486:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 707 00000100:00100000:0.0:1717018889.053490:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 708 00000100:00100000:0.0:1717018889.053493:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819899456:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:0.0:1717018889.053500:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008696ed40 x1800422819899456/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:241/0 lens 224/224 e 0 to 0 dl 1717018976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:0.0:1717018889.053514:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819899456:12345-0@lo:400:kworker/u8:0.0 Request processed in 21us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018889.053517:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 708 00000100:00100000:1.0:1717018889.053520:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819899264:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018889.053535:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819899392:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018889.053558:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899136 00000100:00100000:0.0:1717018889.053575:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1717018889.053578:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819899136:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018889.053618:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819899328:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018889.053635:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819899200:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018889.053645:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b8297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819899456:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018889.053711:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819899136:12345-0@lo:400:kworker/u8:0.0 Request processed in 132us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018889.053716:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1717018889.053718:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819899136:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1717018889.434070:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018890.437699:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018891.438400:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018892.440156:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018892.572503:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819899520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1717018892.572554:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018892.573120:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899520 00000100:00100000:3.0:1717018892.573156:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1717018892.573160:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819899520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1717018892.573188:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1717018892.573236:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819899520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018892.573241:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:1.0:1717018892.573329:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819899520:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717018892.990437:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018892.992131:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669504 00000100:00100000:2.0:1717018892.992183:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1072 00000100:00100000:2.0:1717018892.992188:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:1834:x1800422838669504:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717018892.992242:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:1834:x1800422838669504:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 54us (1814us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018892.992259:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1072 00000100:00100000:0.0:1717018892.993007:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018892.993029:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018892.993073:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018892.993077:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669632 00000100:00100000:0.0:1717018892.993096:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669696 00000100:00100000:1.0:1717018892.993103:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 998 00000100:00100000:1.0:1717018892.993108:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef476c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1834:x1800422838669632:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717018892.993130:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 999 00000100:00100000:0.0:1717018892.993133:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef42140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+519:1833:x1800422838669696:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1717018892.993136:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef476c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1834:x1800422838669632:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 29us (107us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018892.993141:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 998 00000100:00100000:0.0:1717018892.993156:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef42140 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+519:1833:x1800422838669696:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 22us (83us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018892.993161:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 999 00000100:00100000:2.0:1717018892.993243:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669568 00000100:00100000:2.0:1717018892.993274:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 709 00000100:00100000:2.0:1717018892.993277:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef45580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12cff408-c572-49fa-81b0-09052c8e7f41+63:1833:x1800422838669568:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00010000:00000080:2.0:1717018892.993289:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88007ef45580 x1800422838669568/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:244/0 lens 224/224 e 0 to 0 dl 1717018979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717018892.993319:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef45580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12cff408-c572-49fa-81b0-09052c8e7f41+63:1833:x1800422838669568:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 41us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018892.993324:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 709 00010000:00010000:3.0:1717018893.442757:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018894.060072:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b8297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819899712:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018894.060090:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819899584:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018894.060163:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819899648:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018894.060219:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819899776:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018894.060254:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018894.060255:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018894.060273:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819899840:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018894.060286:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018894.060290:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.060418:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819899904:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018894.060495:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899584 00000100:00100000:2.0:1717018894.060522:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1717018894.060523:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018894.060527:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819899584:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018894.060555:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899712 00000100:00100000:2.0:1717018894.060559:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819899584:12345-0@lo:400:kworker/u8:0.0 Request processed in 32us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018894.060563:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:3.0:1717018894.060574:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899648 00000100:00100000:3.0:1717018894.060582:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899904 00000100:00100000:3.0:1717018894.060592:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1717018894.060592:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819899584:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018894.060595:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b06d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819899712:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:3.0:1717018894.060607:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880132b06d40 x1800422819899712/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1717018981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:2.0:1717018894.060621:0:8251:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 711 00000100:00100000:2.0:1717018894.060624:0:8251:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819899648:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:2.0:1717018894.060632:0:8251:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008696d0c0 x1800422819899648/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1717018981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:3.0:1717018894.060645:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b06d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819899712:12345-0@lo:400:kworker/u8:0.0 Request processed in 49us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.060650:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 710 00000100:00100000:2.0:1717018894.060659:0:8251:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696d0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819899648:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.060663:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 712 00000100:00100000:2.0:1717018894.060665:0:8251:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 711 00000100:00100000:3.0:1717018894.060666:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819899904:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:3.0:1717018894.060673:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008696a600 x1800422819899904/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:246/0 lens 224/224 e 0 to 0 dl 1717018981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:3.0:1717018894.060692:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819899904:12345-0@lo:400:kworker/u8:0.0 Request processed in 26us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.060696:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 712 00000100:00100000:3.0:1717018894.060718:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819899648:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018894.060724:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82bdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819899904:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018894.060786:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018894.060809:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899840 00000100:00100000:0.0:1717018894.060846:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899776 00000100:00100000:2.0:1717018894.060860:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1717018894.060864:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819899840:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018894.060892:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819899840:12345-0@lo:400:kworker/u8:0.0 Request processed in 28us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018894.060899:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b8297c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819899712:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018894.060944:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1717018894.060948:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:0.0:1717018894.060948:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef45f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819899776:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018894.060971:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef45f00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819899776:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018894.060975:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1717018894.060991:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819899776:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018894.061078:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819899840:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1717018894.444037:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1717018894.520669:0:28161:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1717018894.520676:0:28161:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1717018894.520679:0:28161:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1717018894.521177:0:28161:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1717018894.521183:0:28161:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1717018894.521209:0:28161:0:(mgs_llog.c:813:mgs_check_marker()) mgs check lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_22d 00000040:00080000:1.0:1717018894.523671:0:28162:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 102 count 100 00000040:00080000:2.0:1717018894.524077:0:28161:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].102, 224 off27144 20000000:01000000:2.0:1717018894.524091:0:28161:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre test_22d (null) (null) 00000040:00080000:2.0:1717018894.524128:0:28161:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].103, 120 off27264 00000040:00080000:2.0:1717018894.524162:0:28161:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].104, 224 off27488 00000040:00080000:2.0:1717018894.524621:0:28161:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].107, 224 off27920 20000000:01000000:2.0:1717018894.524629:0:28161:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce020 lustre test_22d (null) (null) 00000040:00080000:2.0:1717018894.524662:0:28161:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].108, 112 off28032 00000040:00080000:2.0:1717018894.524718:0:28161:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].109, 224 off28256 10000000:01000000:2.0:1717018894.524729:0:28161:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1717018894.524741:0:28161:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524755:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524760:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524765:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524780:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18af expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524785:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18bd expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524788:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18cb expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524793:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524796:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524801:0:28161:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524805:0:28161:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524856:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.524867:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 17 pid: 8249 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.524877:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819899968:0@lo:104: 00000100:00100000:2.0:1717018894.524919:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.525234:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819899968 00010000:00010000:2.0:1717018894.525234:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.525248:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 17 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.525254:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296e3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900032:0@lo:104: 00000100:00100000:2.0:1717018894.525271:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018894.526454:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.526462:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 17 pid: 8250 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.526470:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900096:0@lo:104: 00000100:00100000:2.0:1717018894.526494:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.526508:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900032 00000100:00100000:3.0:1717018894.526532:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1717018894.526536:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819899968:12345-0@lo:104: 00010000:00010000:3.0:1717018894.526572:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018894.526575:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819899968:12345-0@lo:104: Request processed in 39us (1657us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.526580:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1717018894.526590:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1717018894.526592:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:28161:x1800422819900032:12345-0@lo:104: 00010000:00010000:3.0:1717018894.526614:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018894.526616:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296f200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:28161:x1800422819900032:12345-0@lo:104: Request processed in 24us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.526620:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00010000:00010000:3.0:1717018894.526632:0:6619:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1717018894.526635:0:6619:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.526640:0:6619:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e1b00 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018894.526642:0:6619:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.526647:0:6619:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018894.526651:0:6619:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018894.526654:0:6619:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018894.526805:0:6619:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.526809:0:6619:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018894.526823:0:6620:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018894.526838:0:6620:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.526844:0:6620:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e3600 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018894.526845:0:6620:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.526849:0:6620:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018894.526861:0:6620:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018894.526864:0:6620:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018894.526877:0:6620:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.526881:0:6620:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018894.526987:0:6620:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.526992:0:6620:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e3600/0x81e56358f42c18e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18ee expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.527000:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018894.527001:0:6619:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.527001:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018894.527003:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018894.527005:0:6619:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e1b00/0x81e56358f42c18f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18fc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.527011:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018894.527011:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819900224:0@lo:103:ldlm_bl_02.0 00010000:00010000:3.0:1717018894.527012:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018894.527016:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018894.527021:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819900160:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018894.527032:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.527054:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018894.527068:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900224 00000100:00100000:3.0:1717018894.527072:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900160 00010000:00010000:3.0:1717018894.527078:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 19 pid: 8249 timeout: 2027 lvb_type: 0 00010000:00010000:0.0:1717018894.527078:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 19 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:0.0:1717018894.527091:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75373 00000100:00100000:0.0:1717018894.527094:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef43dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819900224:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1717018894.527097:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75374 00000100:00100000:3.0:1717018894.527100:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008696a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819900160:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:0.0:1717018894.527100:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018894.527102:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 19 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.527104:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018894.527106:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 19 pid: 8249 timeout: 2027 lvb_type: 0 00010000:00010000:0.0:1717018894.527108:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 19 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:1.0:1717018894.527147:0:26222:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1717018894.527162:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900096 00000100:00100000:1.0:1717018894.527177:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1717018894.527179:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880081483050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:28161:x1800422819900096:12345-0@lo:104: 00010000:00010000:1.0:1717018894.527202:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1717018894.527205:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880081483050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+3:28161:x1800422819900096:12345-0@lo:104: Request processed in 26us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018894.527209:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00010000:1.0:1717018894.527231:0:12712:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717018894.527233:0:12712:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.527238:0:12712:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e2f40 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:1.0:1717018894.527239:0:12712:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.527243:0:12712:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717018894.527246:0:12712:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717018894.527250:0:12712:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717018894.527260:0:12712:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.527263:0:12712:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717018894.527270:0:12712:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.527274:0:12712:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e2f40/0x81e56358f42c18d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18e0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018894.527288:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018894.527288:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717018894.527289:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018894.527331:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 19 pid: 8249 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.527345:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018894.527370:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008696a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819900160:12345-0@lo:103:ldlm_bl_01.0 Request processed in 269us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.527426:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75374 00000100:00100000:3.0:1717018894.527439:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132b004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819900288:0@lo:103:ldlm_bl_06.0 00000100:00100000:3.0:1717018894.527454:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018894.527486:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018894.527491:0:6618:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900288 00010000:00010000:2.0:1717018894.527499:0:6618:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 19 pid: 8250 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.527521:0:6618:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75375 00000100:00100000:2.0:1717018894.527524:0:6618:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092acaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+19:2854:x1800422819900288:12345-0@lo:103:ldlm_bl_06.0 00010000:00010000:2.0:1717018894.527529:0:6618:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018894.527531:0:6618:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 19 pid: 8250 timeout: 2027 lvb_type: 0 00010000:00010000:2.0:1717018894.527537:0:6618:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 19 pid: 8250 timeout: 2027 lvb_type: 0 00010000:00010000:2.0:1717018894.527544:0:6618:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018894.527586:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696e3c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819900160:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1717018894.527606:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef43dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819900224:12345-0@lo:103:ldlm_bl_02.0 Request processed in 512us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018894.527611:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75373 00000100:00100000:2.0:1717018894.527637:0:6618:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092acaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819900288:12345-0@lo:103:ldlm_bl_06.0 Request processed in 111us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018894.527649:0:6618:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75375 00000100:00100000:1.0:1717018894.527659:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819900224:0@lo:103:ldlm_bl_02.0 00010000:00010000:2.0:1717018894.527665:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18cb expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.527673:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18cb expref: 17 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.527679:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296a600 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900352:0@lo:104: 00000100:00100000:3.0:1717018894.527708:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132b004c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819900288:0@lo:103:ldlm_bl_06.0 00000100:00100000:2.0:1717018894.527752:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018894.527772:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18bd expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.527778:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18bd expref: 17 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.527784:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296df00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900416:0@lo:104: 00000100:00100000:2.0:1717018894.527796:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018894.527810:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900352 00010000:00010000:2.0:1717018894.527816:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18af expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.527822:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18af expref: 17 pid: 8249 timeout: 2027 lvb_type: 0 00000100:00100000:0.0:1717018894.527840:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900416 00000100:00100000:2.0:1717018894.527841:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900480:0@lo:104: 00000100:00100000:0.0:1717018894.527850:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1717018894.527852:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819900352:12345-0@lo:104: 00000100:00100000:2.0:1717018894.527855:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717018894.527865:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.527870:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 17 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:0.0:1717018894.527872:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1717018894.527874:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819900352:12345-0@lo:104: Request processed in 22us (122us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018894.527878:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1717018894.527884:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296bdc0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900544:0@lo:104: 00000100:00100000:0.0:1717018894.527885:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900480 00000100:00100000:0.0:1717018894.527891:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1717018894.527894:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819900416:12345-0@lo:104: 00000100:00100000:2.0:1717018894.527896:0:28161:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018894.527908:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1717018894.527909:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018894.527911:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819900416:12345-0@lo:104: Request processed in 17us (115us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018894.527915:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 8 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:0.0:1717018894.527915:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1717018894.527921:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900608:192.168.203.26@tcp:104: 00000100:00100000:0.0:1717018894.527921:0:6614:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900544 00000100:00100000:0.0:1717018894.527927:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1717018894.527929:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819900480:12345-0@lo:104: 00010000:00010000:0.0:1717018894.527945:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1717018894.527948:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092968000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+4:28161:x1800422819900480:12345-0@lo:104: Request processed in 18us (93us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018894.527951:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:2.0:1717018894.527955:0:28161:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.527960:0:28161:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 2027 lvb_type: 0 00000100:00100000:0.0:1717018894.527962:0:6614:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1717018894.527964:0:6614:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+3:28161:x1800422819900544:12345-0@lo:104: 00000100:00100000:2.0:1717018894.527966:0:28161:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296c280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900672:192.168.203.26@tcp:104: 00000100:00100000:2.0:1717018894.527978:0:28161:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134ca6600 going to sleep for 6 seconds 00010000:00010000:0.0:1717018894.527982:0:6614:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1717018894.527984:0:6614:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:627fc11f-491c-4f89-ad31-986408f4a526+3:28161:x1800422819900544:12345-0@lo:104: Request processed in 20us (88us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018894.527985:0:28161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d1440/0x81e56358f42c18fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18f5 expref: 17 pid: 8249 timeout: 2027 lvb_type: 0 00000100:00100000:0.0:1717018894.527988:0:6614:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1717018894.527995:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819899968:0@lo:104: 00010000:00010000:0.0:1717018894.527998:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1717018894.528000:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528005:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e3a80 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:2.0:1717018894.528006:0:28161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c18ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18e7 expref: 16 pid: 8248 timeout: 2027 lvb_type: 0 10000000:00010000:0.0:1717018894.528006:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018894.528011:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296e3c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900032:0@lo:104: 00010000:00010000:0.0:1717018894.528011:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528015:0:28161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c18e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18d9 expref: 15 pid: 8250 timeout: 2027 lvb_type: 0 10000000:00010000:0.0:1717018894.528015:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018894.528019:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1717018894.528028:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900096:0@lo:104: 00010000:00010000:0.0:1717018894.528030:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018894.528033:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296a600 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900352:0@lo:104: 00010000:00010000:0.0:1717018894.528034:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1717018894.528037:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296df00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900416:0@lo:104: 00010000:00010000:0.0:1717018894.528039:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018894.528041:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900480:0@lo:104: 00010000:00010000:0.0:1717018894.528043:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e3a80/0x81e56358f42c18cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18d2 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018894.528045:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296bdc0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900544:0@lo:104: 00010000:00010000:0.0:1717018894.528049:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1717018894.528054:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528059:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880134f1f180 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:2.0:1717018894.528060:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1717018894.528060:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528062:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528064:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528066:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79d440 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717018894.528068:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018894.528068:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528071:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018894.528071:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1717018894.528075:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018894.528078:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018894.528079:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528082:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018894.528086:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528087:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528090:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018894.528090:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff880134f1f180/0x81e56358f42c18bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18c4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528092:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528095:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79d440/0x81e56358f42c18af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18b6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528096:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717018894.528098:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528101:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79c6c0 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018894.528103:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528107:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018894.528107:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.528108:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717018894.528109:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1717018894.528113:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018894.528117:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018894.528125:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528128:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018894.528131:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528134:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79c6c0/0x81e56358f42c18a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c18a8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018894.528141:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018894.528142:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018894.528143:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018894.528147:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018894.528201:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800929684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819900864:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1717018894.528217:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018894.528229:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1717018894.528233:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819900800:0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1717018894.528243:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.528291:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819900736:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018894.528309:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.528322:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1717018894.528328:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819900928:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018894.528344:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018894.528371:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900864 00010000:00010000:3.0:1717018894.528379:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18af expref: 15 pid: 8249 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.528391:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900800 00010000:00010000:3.0:1717018894.528395:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18bd expref: 16 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.528402:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900736 00010000:00010000:3.0:1717018894.528406:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18cb expref: 17 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.528414:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900928 00010000:00010000:3.0:1717018894.528417:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 18 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.528426:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75376 00000100:00100000:3.0:1717018894.528429:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819900864:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717018894.528436:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018894.528438:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18af expref: 18 pid: 8249 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528442:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18af expref: 18 pid: 8249 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528448:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d0d80/0x81e56358f42c18b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18af expref: 18 pid: 8249 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528454:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018894.528471:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+17:2853:x1800422819900864:12345-0@lo:103:ldlm_bl_03.0 Request processed in 42us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.528480:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75376 00000100:00100000:3.0:1717018894.528489:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75377 00000100:00100000:3.0:1717018894.528491:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+16:2853:x1800422819900800:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018894.528491:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018894.528496:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018894.528499:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18bd expref: 16 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528503:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18bd expref: 16 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.528504:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75378 00000100:00100000:2.0:1717018894.528507:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6df8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+16:2855:x1800422819900736:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:3.0:1717018894.528510:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e3180/0x81e56358f42c18c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18bd expref: 16 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:2.0:1717018894.528511:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018894.528513:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18cb expref: 16 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528515:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717018894.528518:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18cb expref: 15 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:2.0:1717018894.528523:0:14966:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d3600/0x81e56358f42c18d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18cb expref: 15 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.528529:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+14:2853:x1800422819900800:12345-0@lo:103:ldlm_bl_05.0 Request processed in 37us (285us total) trans 0 rc 0/0 00010000:00010000:2.0:1717018894.528531:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018894.528533:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75377 00000100:00100000:3.0:1717018894.528540:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75379 00000100:00100000:3.0:1717018894.528543:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ac8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+13:2855:x1800422819900928:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1717018894.528544:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6df8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+13:2855:x1800422819900736:12345-0@lo:103:ldlm_bl_05.0 Request processed in 37us (235us total) trans 0 rc 0/0 00010000:00010000:3.0:1717018894.528547:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018894.528548:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 13 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:2.0:1717018894.528548:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75378 00010000:00010000:3.0:1717018894.528553:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 12 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528558:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1680/0x81e56358f42c18a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c18a1 expref: 12 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.528571:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018894.528579:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef450c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819900736:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018894.528584:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ac8980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:627fc11f-491c-4f89-ad31-986408f4a526+11:2855:x1800422819900928:12345-0@lo:103:ldlm_bl_05.0 Request processed in 40us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.528588:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75379 00000100:00100000:2.0:1717018894.528594:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef463c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819900928:0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1717018894.528642:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819900800:0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1717018894.528648:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800929684c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819900864:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717018894.529457:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900608:192.168.203.26@tcp:104: 00000100:00100000:2.0:1717018894.529464:0:28161:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296c280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28161:1800422819900672:192.168.203.26@tcp:104: 00010000:00010000:2.0:1717018894.529490:0:28161:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018894.529955:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018894.529978:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018894.529998:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669760 00010000:00010000:3.0:1717018894.530012:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 9 pid: 8248 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.530025:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669824 00010000:00010000:3.0:1717018894.530030:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 10 pid: 8250 timeout: 2027 lvb_type: 0 00000100:00100000:3.0:1717018894.530040:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75380 00000100:00100000:3.0:1717018894.530044:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ac84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+10:1834:x1800422838669760:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1717018894.530051:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018894.530053:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 10 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.530059:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 10 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.530067:0:6616:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c189a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36770 expref: 10 pid: 8248 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.530074:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018894.530095:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ac84c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+9:1834:x1800422838669760:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.530106:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75380 00000100:00100000:3.0:1717018894.530116:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75381 00000100:00100000:3.0:1717018894.530118:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092acdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+8:1834:x1800422838669824:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 00010000:00010000:3.0:1717018894.530122:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018894.530125:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.530131:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.530138:0:6616:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1fa80/0x81e56358f42c1893 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36769 expref: 8 pid: 8250 timeout: 2027 lvb_type: 0 00010000:00010000:3.0:1717018894.530145:0:6616:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530149:0:6616:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530159:0:6616:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530408:0:6616:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530413:0:6616:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530417:0:6616:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530428:0:6616:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2880 already unused, calling callback (ffffffffa0811190) 00010000:00010000:3.0:1717018894.530430:0:6616:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530435:0:6616:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530453:0:6616:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018894.530460:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018894.530482:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092acdf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+7:1834:x1800422838669824:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 Request processed in 362us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018894.530487:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75381 00010000:00010000:2.0:1717018894.530528:0:28161:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.530533:0:28161:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018894.530537:0:28161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d2880/0x81e56358f42c1934 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28161 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018895.446034:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018895.605130:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.605203:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669888 00000100:00100000:0.0:1717018895.606622:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1074 00000100:00100000:0.0:1717018895.606629:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+7:4633:x1800422838669888:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018895.606641:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018895.606657:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36785 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018895.606680:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018895.606686:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018895.606703:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1680, rc 0) 00000100:00100000:0.0:1717018895.606758:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838669888:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 130us (1633us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018895.606763:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1074 00000100:00100000:0.0:1717018895.611598:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.612619:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838669952 00000100:00100000:2.0:1717018895.612664:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1075 00000100:00100000:2.0:1717018895.612668:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838669952:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018895.612791:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838669952:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 122us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018895.612797:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1075 00000100:00100000:0.0:1717018895.615558:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.615654:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670016 00000100:00100000:2.0:1717018895.615682:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1076 00000100:00100000:2.0:1717018895.615686:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670016:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018895.615898:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670016:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 211us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018895.615904:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1076 00000100:00100000:0.0:1717018895.619066:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.619226:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670080 00000100:00100000:2.0:1717018895.619259:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1077 00000100:00100000:2.0:1717018895.619264:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:23243:x1800422838670080:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1717018895.619591:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:23243:x1800422838670080:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 327us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018895.619603:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1077 00000100:00100000:0.0:1717018895.622169:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.622291:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670144 00000100:00100000:2.0:1717018895.623561:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1078 00000100:00100000:2.0:1717018895.623568:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:23243:x1800422838670144:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1717018895.623804:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:23243:x1800422838670144:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 237us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018895.623810:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1078 00000100:00100000:0.0:1717018895.626122:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.626500:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670208 00000100:00100000:2.0:1717018895.626536:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1079 00000100:00100000:2.0:1717018895.626540:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670208:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018895.626550:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018895.626563:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3678c expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.626581:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 9 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.626587:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 9 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018895.626593:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d1440, rc 0) 00000100:00100000:2.0:1717018895.626624:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838670208:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 83us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018895.626628:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1079 00000100:00100000:0.0:1717018895.627702:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018895.627844:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670272 00000100:00100000:2.0:1717018895.627864:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1080 00000100:00100000:2.0:1717018895.627875:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838670272:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018895.628195:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838670272:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 319us (494us total) trans 0 rc -2/-2 00000100:00100000:2.0:1717018895.628202:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1080 00010000:00010000:1.0:1717018896.448103:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1717018896.466928:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717018896.466934:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 107 10000000:01000000:0.0:1717018896.466938:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717018896.466968:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.466975:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.466982:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018896.466999:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819900992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018896.467045:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018896.467072:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752d80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018896.467137:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819900992 00000100:00100000:2.0:1717018896.467169:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1717018896.467173:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819900992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018896.467182:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018896.467192:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1949 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.467208:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1949 expref: 12 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.467214:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1949 expref: 12 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.467219:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d33c0, rc 0) 00000100:00100000:2.0:1717018896.467258:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819900992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018896.467263:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:1.0:1717018896.467292:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819900992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018896.467303:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.467309:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018896.467387:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.467406:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018896.467425:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cc900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.467444:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901056 00000100:00100000:0.0:1717018896.467466:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1717018896.467469:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819901056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018896.467563:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819901056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.467567:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:1.0:1717018896.468059:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.468080:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.468113:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018896.468134:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cc900 going to sleep for 6 seconds 00000100:00100000:2.0:1717018896.468160:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901120 00000100:00100000:2.0:1717018896.468182:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1717018896.468185:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819901120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.468333:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819901120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 146us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018896.468346:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:1.0:1717018896.468704:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.469137:0:28164:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28164:1800422819901184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018896.469164:0:28164:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018896.469184:0:28164:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cc900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.469213:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901184 00000100:00100000:0.0:1717018896.469231:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1717018896.469234:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:28164:x1800422819901184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018896.469502:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:28164:x1800422819901184:12345-0@lo:502:llog_process_th.0 Request processed in 267us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.469507:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:1.0:1717018896.469696:0:28164:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28164:1800422819901184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018896.469728:0:28164:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28164:1800422819901248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018896.469750:0:28164:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018896.469770:0:28164:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cc900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.469818:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901248 00000100:00100000:0.0:1717018896.469897:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1717018896.469900:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:28164:x1800422819901248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018896.470182:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:28164:x1800422819901248:12345-0@lo:502:llog_process_th.0 Request processed in 280us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.470187:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:1.0:1717018896.470248:0:28164:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28164:1800422819901248:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1717018896.470264:0:28164:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 110 count 108 00000020:01000000:2.0:1717018896.470481:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 107-109 (rc=0) 10000000:01000000:2.0:1717018896.470498:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018896.470503:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.470511:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018896.470517:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1717018896.470519:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 102 10000000:01000000:2.0:1717018896.470521:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1717018896.470535:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.470540:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.470546:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.470554:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.470573:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.470591:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092a11840 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.470629:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901312 00000100:00100000:0.0:1717018896.470641:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:0.0:1717018896.470644:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819901312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018896.470649:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018896.470658:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1957 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.470671:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1957 expref: 13 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.470677:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1957 expref: 13 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.470687:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1b00, rc 0) 00000100:00100000:0.0:1717018896.470719:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819901312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.470724:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:3.0:1717018896.470849:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018896.470858:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.470863:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018896.470894:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.470913:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.470927:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012b85fd80 going to sleep for 6 seconds 00000100:00100000:2.0:1717018896.470974:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901376 00000100:00100000:2.0:1717018896.470988:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1717018896.470991:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819901376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.471066:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819901376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018896.471070:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:3.0:1717018896.471176:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.471195:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.471221:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.471380:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012b85fd80 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.471409:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901440 00000100:00100000:0.0:1717018896.471616:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1717018896.471620:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d912850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819901440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018896.471774:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d912850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819901440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.471779:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:3.0:1717018896.471801:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.472107:0:28165:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28165:1800422819901504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018896.472128:0:28165:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018896.472168:0:28165:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349cc900 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.472172:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901504 00000100:00100000:0.0:1717018896.472192:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1717018896.472195:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28165:x1800422819901504:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018896.472486:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28165:x1800422819901504:12345-0@lo:502:llog_process_th.0 Request processed in 289us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.472532:0:28165:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28165:1800422819901504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1717018896.472550:0:28165:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1717018896.472556:0:28165:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1717018896.472557:0:28165:0:(obd_config.c:1460:class_process_config()) marker 69 (0x1) lustre-MDT0000-m new lustre.test_22d 00000020:00000080:1.0:1717018896.472560:0:28165:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1717018896.472583:0:28165:0:(lod_pool.c:497:lod_pool_new()) test_22d is pool #2 00000100:00100000:0.0:1717018896.472734:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00080000:10000000:1.0:1717018896.473355:0:28165:0:(osd_index.c:2094:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4d:0x0] (8/8/4) registered 00080000:10000000:2.0:1717018896.497976:0:28165:0:(osd_index.c:2094:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4e:0x0] (8/8/4) registered 00080000:10000000:3.0:1717018896.516815:0:28165:0:(osd_index.c:2094:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x4f:0x0] (8/8/4) registered 00000100:00100000:3.0:1717018896.542287:0:28165:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28165:1800422819901568:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.542351:0:28165:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.542369:0:28165:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132fc0480 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.543573:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901568 00000100:00100000:0.0:1717018896.543604:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1717018896.543608:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28165:x1800422819901568:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018896.543811:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28165:x1800422819901568:12345-0@lo:502:llog_process_th.0 Request processed in 202us (1460us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.543817:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:3.0:1717018896.543984:0:28165:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28165:1800422819901568:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717018896.544004:0:28165:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1717018896.544008:0:28165:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018896.544009:0:28165:0:(obd_config.c:1460:class_process_config()) marker 69 (0x2) lustre-MDT0000-m new lustre.test_22d 00000040:00080000:3.0:1717018896.544012:0:28165:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 105 count 103 00000020:01000000:2.0:1717018896.544119:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 102-104 (rc=0) 10000000:01000000:2.0:1717018896.544159:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1717018896.544164:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.544172:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018896.544179:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018896.544181:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 107 10000000:01000000:2.0:1717018896.544183:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018896.544198:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.544203:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.544209:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.544220:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.544243:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.544260:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018896.544297:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901632 00000100:00100000:3.0:1717018896.544313:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:3.0:1717018896.544316:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819901632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018896.544322:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018896.544330:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1965 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.544354:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1965 expref: 14 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.544361:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1965 expref: 14 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.544366:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1fcc0, rc 0) 00000100:00100000:3.0:1717018896.544390:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819901632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018896.544398:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1717018896.544457:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018896.544465:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.544471:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.544500:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.544520:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.544527:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.544569:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901696 00000100:00100000:1.0:1717018896.544586:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:1.0:1717018896.544592:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819901696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.544684:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819901696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.544689:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1717018896.544693:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.544710:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.544732:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.544738:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.544746:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901760 00000100:00100000:1.0:1717018896.544757:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:1.0:1717018896.544760:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819901760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.544894:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819901760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.544900:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1717018896.544903:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.545177:0:28218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28218:1800422819901824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.545201:0:28218:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.545211:0:28218:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132fc0540 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.545270:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901824 00000100:00100000:1.0:1717018896.545282:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:1.0:1717018896.545285:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:28218:x1800422819901824:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018896.545497:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:28218:x1800422819901824:12345-0@lo:502:llog_process_th.0 Request processed in 211us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.545502:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:3.0:1717018896.545513:0:28218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28218:1800422819901824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.545537:0:28218:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28218:1800422819901888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.545564:0:28218:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.545573:0:28218:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132fc0540 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.545730:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901888 00000100:00100000:1.0:1717018896.545778:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:1.0:1717018896.545781:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:28218:x1800422819901888:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018896.546125:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:28218:x1800422819901888:12345-0@lo:502:llog_process_th.0 Request processed in 342us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.546131:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:3.0:1717018896.546181:0:28218:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28218:1800422819901888:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018896.546196:0:28218:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 110 count 108 00000020:01000000:2.0:1717018896.546301:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 107-109 (rc=0) 10000000:01000000:2.0:1717018896.546315:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018896.546529:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.546538:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018896.546544:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1717018896.546546:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1717018896.546548:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1717018896.546560:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.546565:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.546570:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.546579:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.546604:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.546625:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.546669:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819901952 00000100:00100000:1.0:1717018896.546683:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1717018896.546686:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819901952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018896.546691:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018896.546703:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1973 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.546716:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1973 expref: 15 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.546722:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1973 expref: 15 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.546727:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79c6c0, rc 0) 00000100:00100000:1.0:1717018896.546745:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819901952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 59us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.546750:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1717018896.547094:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819901952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018896.547103:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.547108:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.547136:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.547155:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.547163:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018896.547252:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902016 00000100:00100000:3.0:1717018896.547274:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:3.0:1717018896.547278:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819902016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.547779:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819902016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 500us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018896.547785:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1717018896.547854:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.547873:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.547898:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.547906:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018896.547952:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902080 00000100:00100000:3.0:1717018896.547976:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:3.0:1717018896.547979:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819902080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.548125:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819902080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018896.548130:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1717018896.548224:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902080:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717018896.549121:0:28220:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1717018896.549279:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1717018896.549295:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1717018896.549300:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.549307:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018896.549314:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018896.549315:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 107 10000000:01000000:2.0:1717018896.549321:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018896.549355:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.549360:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.549366:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.549379:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.549405:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.549456:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.549530:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902144 00000100:00100000:0.0:1717018896.549561:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1717018896.549565:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819902144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018896.549576:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018896.549586:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1981 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.549600:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1981 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.549606:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1981 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018896.549612:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e33c0, rc 0) 00000100:00100000:0.0:1717018896.549633:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819902144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.549638:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1717018896.549750:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018896.549759:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.549764:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.549797:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.549814:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.549842:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:3.0:1717018896.549937:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902208 00000100:00100000:3.0:1717018896.549956:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:3.0:1717018896.549958:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819902208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.550038:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819902208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018896.550043:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1717018896.550091:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.550107:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.550131:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.550151:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66eb40 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.550309:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902272 00000100:00100000:0.0:1717018896.550325:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:0.0:1717018896.550327:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819902272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018896.550474:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819902272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.550478:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1717018896.550678:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018896.551189:0:28222:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28222:1800422819902336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.551216:0:28222:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.551227:0:28222:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132fc0840 going to sleep for 6 seconds 00000100:00100000:2.0:1717018896.551261:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902336 00000100:00100000:2.0:1717018896.551277:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:2.0:1717018896.551280:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:28222:x1800422819902336:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018896.551519:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:28222:x1800422819902336:12345-0@lo:502:llog_process_th.0 Request processed in 238us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018896.551524:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1717018896.551541:0:28222:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28222:1800422819902336:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.551570:0:28222:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28222:1800422819902400:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018896.551589:0:28222:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018896.551609:0:28222:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132fc0840 going to sleep for 6 seconds 00000100:00100000:0.0:1717018896.551645:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902400 00000100:00100000:0.0:1717018896.551657:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1717018896.551659:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:28222:x1800422819902400:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018896.551778:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:28222:x1800422819902400:12345-0@lo:502:llog_process_th.0 Request processed in 117us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018896.551782:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1717018896.551848:0:28222:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28222:1800422819902400:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018896.551864:0:28222:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 110 count 108 00000020:01000000:2.0:1717018896.552496:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 107-109 (rc=0) 10000000:01000000:2.0:1717018896.552513:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018896.552518:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.552526:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018896.552532:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1717018896.552534:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1717018896.552536:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1717018896.552550:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.552555:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.552561:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.552569:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.552591:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.552639:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e480 going to sleep for 6 seconds 00000100:00100000:3.0:1717018896.552675:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902464 00000100:00100000:3.0:1717018896.552693:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1717018896.552696:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819902464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018896.552702:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018896.552711:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c198f expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.552726:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c198f expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.552732:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c198f expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018896.552745:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1f3c0, rc 0) 00000100:00100000:3.0:1717018896.552769:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819902464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018896.552774:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:2.0:1717018896.552848:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018896.552856:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.552861:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.552891:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.552908:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.552924:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.552957:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902528 00000100:00100000:1.0:1717018896.552972:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:1.0:1717018896.552975:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819902528:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.553147:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819902528:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.553152:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:2.0:1717018896.553229:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902528:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.553251:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.553276:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.553295:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.553344:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902592 00000100:00100000:1.0:1717018896.553357:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1717018896.553360:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819902592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.553479:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819902592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.553484:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:2.0:1717018896.553487:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1717018896.554298:0:28225:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:2.0:1717018896.554391:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1717018896.554404:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1717018896.554408:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.554415:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018896.554421:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1717018896.554423:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:2.0:1717018896.554424:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1717018896.554437:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.554449:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.554455:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.554465:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.554487:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.554495:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.554741:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902656 00000100:00100000:1.0:1717018896.554793:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1717018896.554796:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819902656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018896.554807:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018896.554815:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c199d expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.554989:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c199d expref: 18 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.554996:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c199d expref: 18 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018896.555001:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79dd40, rc 0) 00000100:00100000:1.0:1717018896.555022:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819902656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 225us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018896.555026:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:2.0:1717018896.555100:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018896.555110:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.555116:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018896.555145:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018896.555163:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018896.555171:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e480 going to sleep for 6 seconds 00000100:00100000:1.0:1717018896.555225:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902720 00000100:00100000:1.0:1717018896.555238:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1717018896.555241:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819902720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018896.555297:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819902720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (133us total) trans 0 rc -2/-2 00000100:00100000:1.0:1717018896.555302:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:2.0:1717018896.555365:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092969300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819902720:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1717018896.555379:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1717018896.555382:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018896.555386:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000020:00000080:3.0:1717018897.238705:0:28346:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1717018897.238712:0:28346:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1717018897.238716:0:28346:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1717018897.239401:0:28346:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:3.0:1717018897.239408:0:28346:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:3.0:1717018897.239436:0:28346:0:(mgs_llog.c:813:mgs_check_marker()) mgs check lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_22d.lustre-OST0000_UUID 00000040:00080000:3.0:1717018897.240126:0:28347:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 105 count 103 00000040:00080000:0.0:1717018897.240761:0:28346:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].105, 224 off27712 20000000:01000000:0.0:1717018897.240782:0:28346:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_22d lustre-OST0000_UUID (null) 00000040:00080000:0.0:1717018897.240814:0:28346:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].106, 144 off27856 00000040:00080000:0.0:1717018897.240985:0:28346:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].107, 224 off28080 00000040:00080000:0.0:1717018897.241431:0:28346:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].110, 224 off28480 20000000:01000000:0.0:1717018897.241438:0:28346:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce021 lustre test_22d lustre-OST0000_UUID (null) 00000040:00080000:0.0:1717018897.241458:0:28346:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].111, 136 off28616 00000040:00080000:0.0:1717018897.241498:0:28346:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].112, 224 off28840 10000000:01000000:0.0:1717018897.241505:0:28346:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1717018897.241515:0:28346:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241527:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241530:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241534:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1949 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241536:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1957 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241538:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1965 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241541:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1973 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241543:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1981 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241546:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c198f expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241552:0:28346:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c199d expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241555:0:28346:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241579:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c199d expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241586:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c199d expref: 17 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.241593:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef41300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902784:0@lo:104: 00000100:00100000:0.0:1717018897.241629:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018897.241656:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c198f expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241661:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c198f expref: 17 pid: 8249 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.241666:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef44c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902848:0@lo:104: 00000100:00100000:0.0:1717018897.241679:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018897.241720:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902784 00010000:00010000:0.0:1717018897.241728:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1981 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241733:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1981 expref: 17 pid: 8250 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.241738:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902912:0@lo:104: 00000100:00100000:0.0:1717018897.241752:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018897.241894:0:26222:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1717018897.241901:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902848 00010000:00010000:0.0:1717018897.241902:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1973 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241908:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1973 expref: 17 pid: 8250 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.241910:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902912 00000100:00100000:0.0:1717018897.241914:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902976:0@lo:104: 00000100:00100000:3.0:1717018897.241917:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1717018897.241920:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef40980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+5:28346:x1800422819902784:12345-0@lo:104: 00000100:00100000:0.0:1717018897.241929:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018897.241938:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1965 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.241943:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1965 expref: 17 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.241949:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef450c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903040:0@lo:104: 00000100:00100000:0.0:1717018897.241960:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1717018897.241962:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717018897.241965:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef40980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+5:28346:x1800422819902784:12345-0@lo:104: Request processed in 45us (336us total) trans 0 rc 0/0 00010000:00010000:0.0:1717018897.241968:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1957 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.241970:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00010000:00010000:0.0:1717018897.241972:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1957 expref: 17 pid: 8249 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.241977:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88007ef40e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903104:0@lo:104: 00000100:00100000:3.0:1717018897.241981:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819902976 00000100:00100000:3.0:1717018897.241986:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903040 00000100:00100000:0.0:1717018897.241989:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018897.241991:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903104 00000100:00100000:3.0:1717018897.241996:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00010000:00010000:0.0:1717018897.241997:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c1949 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.241998:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef417c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+7:28346:x1800422819902848:12345-0@lo:104: 00010000:00010000:0.0:1717018897.242002:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c1949 expref: 17 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.242008:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880090589c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903168:0@lo:104: 00000100:00100000:0.0:1717018897.242018:0:28346:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1717018897.242023:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018897.242025:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef417c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+7:28346:x1800422819902848:12345-0@lo:104: Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.242033:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00010000:0.0:1717018897.242034:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717018897.242037:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.242041:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903168 00010000:00010000:0.0:1717018897.242042:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1f80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018897.242045:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.242047:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1717018897.242049:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092754850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+7:28346:x1800422819902912:12345-0@lo:104: 00010000:00010000:0.0:1717018897.242051:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018897.242055:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018897.242058:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018897.242068:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717018897.242071:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092754850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+7:28346:x1800422819902912:12345-0@lo:104: Request processed in 21us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.242074:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00010000:0.0:1717018897.242074:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242079:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018897.242089:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242093:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c199d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c19a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.242097:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1717018897.242099:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef463c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+6:28346:x1800422819902976:12345-0@lo:104: 00010000:00010000:0.0:1717018897.242101:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717018897.242102:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242106:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d3600 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018897.242107:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242116:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1717018897.242117:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.242118:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef463c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+6:28346:x1800422819902976:12345-0@lo:104: Request processed in 18us (189us total) trans 0 rc 0/0 10000000:00010000:0.0:1717018897.242121:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.242122:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 10000000:01000000:0.0:1717018897.242125:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1717018897.242127:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1717018897.242129:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88007ef43dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+5:28346:x1800422819903040:12345-0@lo:104: 00010000:00010000:0.0:1717018897.242132:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242136:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018897.242143:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1717018897.242145:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88007ef43dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+5:28346:x1800422819903040:12345-0@lo:104: Request processed in 15us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.242149:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:3.0:1717018897.242155:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1717018897.242157:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090589300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:28346:x1800422819903104:12345-0@lo:104: 00000100:00100000:2.0:1717018897.242174:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1717018897.242178:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:28346:x1800422819903168:12345-0@lo:104: 00010000:00010000:3.0:1717018897.242684:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1717018897.242688:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090589300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:28346:x1800422819903104:12345-0@lo:104: Request processed in 529us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018897.242688:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1717018897.242698:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009058aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819903296:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018897.242699:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1717018897.242719:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018897.242750:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242756:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c198f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1996 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242766:0:12711:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1717018897.242768:0:12711:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242771:0:12711:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2880 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717018897.242773:0:12711:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.242777:0:12711:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1717018897.242781:0:12711:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018897.242785:0:12711:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1717018897.242800:0:12711:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242850:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1717018897.242850:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1717018897.242854:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058a140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:28346:x1800422819903168:12345-0@lo:104: Request processed in 675us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018897.242858:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00010000:3.0:1717018897.242861:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242865:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d21c0 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018897.242867:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242871:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018897.242874:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018897.242877:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1717018897.242880:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009058a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819903232:0@lo:103:ldlm_bl_05.0 00010000:00010000:3.0:1717018897.242888:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242892:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018897.242898:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018897.242898:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1717018897.242902:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d21c0/0x81e56358f42c1973 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c197a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242908:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1717018897.242910:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242914:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d06c0 already unused, calling callback (ffffffffa02815c0) 00000100:00100000:2.0:1717018897.242918:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903296 10000000:00010000:3.0:1717018897.242919:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242923:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018897.242927:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.242927:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c198f expref: 18 pid: 8249 timeout: 2030 lvb_type: 0 10000000:01000000:3.0:1717018897.242931:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018897.242938:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018897.242941:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903232 00010000:00010000:3.0:1717018897.242942:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717018897.242946:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c199d expref: 19 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.242947:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242951:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d06c0/0x81e56358f42c1965 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c196c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018897.242955:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75382 00010000:00010000:3.0:1717018897.242956:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1717018897.242958:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018897.242958:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819903296:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:3.0:1717018897.242962:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1680 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018897.242963:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.242964:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018897.242966:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.242966:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c198f expref: 19 pid: 8249 timeout: 2030 lvb_type: 0 10000000:00010000:3.0:1717018897.242970:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.242972:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c198f expref: 19 pid: 8249 timeout: 2030 lvb_type: 0 10000000:01000000:3.0:1717018897.242979:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717018897.242981:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1717018897.242986:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.242990:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018897.242993:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018897.242994:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819903296:12345-0@lo:103:ldlm_bl_05.0 Request processed in 35us (275us total) trans 0 rc 0/0 00010000:00010000:3.0:1717018897.242997:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c1957 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c195e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.243002:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1717018897.243003:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.243007:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e3180 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717018897.243008:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.243011:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717018897.243015:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018897.243017:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717018897.243025:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.243028:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717018897.243031:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.243038:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e3180/0x81e56358f42c1949 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1950 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.243045:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018897.243045:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018897.243047:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018897.243054:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819903488:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1717018897.243071:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018897.243085:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1717018897.243088:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819903552:0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1717018897.243092:0:12711:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717018897.243096:0:12711:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.243099:0:12711:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c1981 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c1988 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.243102:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1717018897.243110:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018897.243111:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018897.243112:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018897.243113:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717018897.243115:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717018897.243117:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018897.243120:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819903616:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1717018897.243123:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903488 00010000:00010000:3.0:1717018897.243131:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1965 expref: 20 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.243137:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018897.243146:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1717018897.243149:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819903424:0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1717018897.243159:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018897.243165:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009058b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819903360:0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1717018897.243174:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018897.243184:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903552 00010000:00010000:0.0:1717018897.243190:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1957 expref: 21 pid: 8249 timeout: 2030 lvb_type: 0 00010000:00010000:1.0:1717018897.243225:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717018897.243236:0:11917:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903616 00010000:00010000:1.0:1717018897.243244:0:11917:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1949 expref: 22 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:2.0:1717018897.243455:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75382 00000100:00100000:3.0:1717018897.243468:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903424 00000100:00100000:2.0:1717018897.243469:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903360 00010000:00010000:3.0:1717018897.243475:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1973 expref: 23 pid: 8250 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243475:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1981 expref: 23 pid: 8250 timeout: 2030 lvb_type: 0 00000100:00100000:2.0:1717018897.243483:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75383 00000100:00100000:3.0:1717018897.243485:0:10306:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75384 00000100:00100000:2.0:1717018897.243485:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092969300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+23:2855:x1800422819903232:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018897.243487:0:10306:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092acaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+23:2854:x1800422819903488:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018897.243490:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018897.243492:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c199d expref: 23 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243497:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c199d expref: 23 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243504:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018897.243520:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092969300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+23:2855:x1800422819903232:12345-0@lo:103:ldlm_bl_05.0 Request processed in 34us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018897.243524:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75383 00000100:00100000:2.0:1717018897.243531:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75385 00000100:00100000:2.0:1717018897.243533:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+22:2852:x1800422819903360:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018897.243538:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018897.243540:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1981 expref: 22 pid: 8250 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243544:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1981 expref: 22 pid: 8250 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243549:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018897.243563:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+22:2852:x1800422819903360:12345-0@lo:103:ldlm_bl_05.0 Request processed in 29us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018897.243570:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75385 00000100:00100000:2.0:1717018897.243579:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75386 00000100:00100000:2.0:1717018897.243581:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+21:2852:x1800422819903424:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1717018897.243585:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018897.243587:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1973 expref: 21 pid: 8250 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243591:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1973 expref: 21 pid: 8250 timeout: 2030 lvb_type: 0 00010000:00010000:2.0:1717018897.243596:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018897.243609:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+21:2852:x1800422819903424:12345-0@lo:103:ldlm_bl_03.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018897.243612:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75386 00000100:00100000:2.0:1717018897.243639:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009058a600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819903232:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1717018897.243683:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.243690:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 8 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:2.0:1717018897.243697:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296bdc0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903680:192.168.203.26@tcp:104: 00010000:00010000:3.0:1717018897.243887:0:10306:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717018897.243890:0:10306:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1965 expref: 20 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.243896:0:10306:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1965 expref: 20 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.243920:0:10306:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717018897.243951:0:10306:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092acaf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:627fc11f-491c-4f89-ad31-986408f4a526+20:2854:x1800422819903488:12345-0@lo:103:ldlm_bl_03.0 Request processed in 463us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.243955:0:10306:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75384 00000100:00100000:3.0:1717018897.243979:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819903488:0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1717018897.244057:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75387 00000100:00100000:0.0:1717018897.244061:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+19:2854:x1800422819903552:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1717018897.244065:0:11917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75388 00010000:00010000:0.0:1717018897.244066:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1717018897.244067:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819903424:0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1717018897.244069:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1957 expref: 19 pid: 8249 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244072:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009058b900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819903360:0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1717018897.244073:0:11917:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819903616:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1717018897.244078:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1957 expref: 19 pid: 8249 timeout: 2030 lvb_type: 0 00010000:00010000:1.0:1717018897.244080:0:11917:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717018897.244083:0:11917:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c1949 expref: 19 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:0.0:1717018897.244085:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717018897.244090:0:11917:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c1949 expref: 19 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.244097:0:28346:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.244104:0:28346:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 8 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.244108:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dd6850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+19:2854:x1800422819903552:12345-0@lo:103:ldlm_bl_03.0 Request processed in 47us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.244111:0:28346:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903744:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717018897.244112:0:11917:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1717018897.244113:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75387 00000100:00100000:3.0:1717018897.244122:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acaac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819903552:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1717018897.244135:0:11917:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819903616:12345-0@lo:103:ldlm_bl_03.0 Request processed in 62us (998us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.244136:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819903616:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1717018897.244140:0:11917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75388 00000100:00100000:3.0:1717018897.244154:0:28346:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752b40 going to sleep for 6 seconds 00010000:00010000:3.0:1717018897.244161:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c199d expref: 17 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:1.0:1717018897.244167:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009058aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819903296:0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1717018897.244309:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef41300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902784:0@lo:104: 00010000:00010000:3.0:1717018897.244320:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1f3c0/0x81e56358f42c1996 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c198f expref: 16 pid: 8249 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244327:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef44c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902848:0@lo:104: 00010000:00010000:3.0:1717018897.244349:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e33c0/0x81e56358f42c1988 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1981 expref: 15 pid: 8250 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244354:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef42600 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902912:0@lo:104: 00010000:00010000:3.0:1717018897.244359:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c197a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1973 expref: 14 pid: 8250 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244364:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819902976:0@lo:104: 00010000:00010000:3.0:1717018897.244369:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1fcc0/0x81e56358f42c196c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1965 expref: 13 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244374:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef450c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903040:0@lo:104: 00010000:00010000:3.0:1717018897.244379:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1b00/0x81e56358f42c195e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1957 expref: 12 pid: 8249 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244384:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88007ef40e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903104:0@lo:104: 00010000:00010000:3.0:1717018897.244389:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c1950 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c1949 expref: 11 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:3.0:1717018897.244397:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880090589c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903168:0@lo:104: 00000100:00100000:3.0:1717018897.245571:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296bdc0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903680:192.168.203.26@tcp:104: 00000100:00100000:0.0:1717018897.245750:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018897.245780:0:28346:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092acc740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:28346:1800422819903744:192.168.203.26@tcp:104: 00000100:00100000:0.0:1717018897.245782:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018897.245798:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670336 00010000:00010000:3.0:1717018897.245809:0:28346:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245813:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 9 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.245842:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670400 00010000:00010000:0.0:1717018897.245849:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00000100:00100000:0.0:1717018897.245858:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75389 00000100:00100000:0.0:1717018897.245862:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:461e9689-0dac-4669-87c3-00abdddc539f+10:1834:x1800422838670336:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 00000100:00100000:3.0:1717018897.245865:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75390 00000100:00100000:3.0:1717018897.245868:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:461e9689-0dac-4669-87c3-00abdddc539f+10:1834:x1800422838670400:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 00010000:00010000:0.0:1717018897.245869:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018897.245871:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.245872:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717018897.245877:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.245879:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:0.0:1717018897.245884:0:14966:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d1440/0x81e56358f42c1942 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3678c expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.245885:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:3.0:1717018897.245891:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1680/0x81e56358f42c193b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36785 expref: 10 pid: 8248 timeout: 2030 lvb_type: 0 00010000:00010000:0.0:1717018897.245898:0:14966:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245902:0:14966:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.245906:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1717018897.245911:0:14966:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245914:0:14966:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245919:0:14966:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245922:0:14966:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245926:0:14966:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e21c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:0.0:1717018897.245928:0:14966:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245933:0:14966:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018897.245935:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:461e9689-0dac-4669-87c3-00abdddc539f+8:1834:x1800422838670400:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018897.245940:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75390 00010000:00010000:0.0:1717018897.245952:0:14966:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018897.245958:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1717018897.245970:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058e880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:461e9689-0dac-4669-87c3-00abdddc539f+7:1834:x1800422838670336:12345-192.168.203.26@tcp:103:ldlm_bl_04.0 Request processed in 108us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018897.245974:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75389 00010000:00010000:2.0:1717018897.246125:0:28346:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.246130:0:28346:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018897.246133:0:28346:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e21c0/0x81e56358f42c19ab lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 28346 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018897.450043:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717018897.580731:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1717018897.580805:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018897.580934:0:13505:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903808 00000100:00100000:0.0:1717018897.580990:0:13505:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00000100:00100000:0.0:1717018897.580995:0:13505:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092acc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819903808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1717018897.581033:0:13505:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:0.0:1717018897.581667:0:13505:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092acc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819903808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 670us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018897.581675:0:13505:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:3.0:1717018897.581764:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819903808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717018897.998474:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018897.998521:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717018897.998566:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018897.998648:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670464 00000100:00100000:2.0:1717018897.998648:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670528 00000100:00100000:1.0:1717018897.998655:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670592 00000100:00100000:3.0:1717018897.998679:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 713 00000100:00100000:2.0:1717018897.998679:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1002 00000100:00100000:2.0:1717018897.998683:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1833:x1800422838670528:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717018897.998684:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090588e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+63:1833:x1800422838670464:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00010000:00000080:3.0:1717018897.998702:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880090588e40 x1800422838670464/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:249/0 lens 224/224 e 0 to 0 dl 1717018984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:4.0' 00000100:00100000:1.0:1717018897.998707:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1003 00000100:00100000:1.0:1717018897.998713:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800905897c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1833:x1800422838670592:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717018897.998729:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1833:x1800422838670528:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018897.998735:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1002 00000100:00100000:3.0:1717018897.998769:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090588e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+63:1833:x1800422838670464:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 85us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018897.998790:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800905897c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1833:x1800422838670592:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 77us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018897.998797:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1003 00000100:00100000:3.0:1717018897.998805:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 713 10000000:01000000:0.0:1717018898.157179:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717018898.157185:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 110 10000000:01000000:0.0:1717018898.157189:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717018898.157223:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.157232:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.157239:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018898.157257:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819903872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.157311:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.157368:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752c00 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.157452:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903872 00000100:00100000:1.0:1717018898.157894:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1717018898.157903:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819903872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018898.157913:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018898.157924:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c19b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c19b2 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.157943:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c19b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c19b2 expref: 12 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.157959:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c19b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c19b2 expref: 12 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.157965:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79c6c0, rc 0) 00000100:00100000:1.0:1717018898.157998:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819903872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.158003:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:0.0:1717018898.158037:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819903872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018898.158046:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19b9 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.158059:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19b9 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018898.158098:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819903936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.158115:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.158134:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752c00 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.158179:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819903936 00000100:00100000:1.0:1717018898.158201:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1717018898.158204:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819903936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018898.158281:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819903936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 76us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.158285:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:0.0:1717018898.158373:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819903936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.158391:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.158417:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.158423:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752c00 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.158483:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904000 00000100:00100000:2.0:1717018898.158507:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1717018898.158510:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819904000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.158650:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819904000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 139us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.158655:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:0.0:1717018898.158690:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.158888:0:28349:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28349:1800422819904064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.158910:0:28349:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.158968:0:28349:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752c00 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.159007:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904064 00000100:00100000:2.0:1717018898.159032:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1717018898.159035:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:28349:x1800422819904064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018898.159421:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:28349:x1800422819904064:12345-0@lo:502:llog_process_th.0 Request processed in 384us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.159426:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:0.0:1717018898.159449:0:28349:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28349:1800422819904064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.159474:0:28349:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28349:1800422819904128:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.159495:0:28349:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.159501:0:28349:0:(client.c:2492:ptlrpc_set_wait()) set ffff88012e752c00 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.159506:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904128 00000100:00100000:2.0:1717018898.159529:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1717018898.159532:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:28349:x1800422819904128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018898.159685:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:28349:x1800422819904128:12345-0@lo:502:llog_process_th.0 Request processed in 152us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.159690:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:0.0:1717018898.159707:0:28349:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28349:1800422819904128:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1717018898.159722:0:28349:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 113 count 111 00000020:01000000:2.0:1717018898.159760:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 110-112 (rc=0) 10000000:01000000:2.0:1717018898.159772:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018898.159777:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19b9 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.159783:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c19b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19b9 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018898.159789:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1717018898.159791:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 105 10000000:01000000:2.0:1717018898.159793:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1717018898.159806:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.159889:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.159894:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.159903:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.159920:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.159926:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.159935:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904192 00000100:00100000:0.0:1717018898.160143:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1717018898.160147:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819904192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018898.160157:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018898.160166:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e0900/0x81e56358f42c19c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c19c0 expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.160179:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e0900/0x81e56358f42c19c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c19c0 expref: 13 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.160185:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e0900/0x81e56358f42c19c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c19c0 expref: 13 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.160189:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e0900, rc 0) 00000100:00100000:0.0:1717018898.160277:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819904192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.160282:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:2.0:1717018898.160389:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.160398:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19c7 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.160404:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19c7 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.160431:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.160452:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.160459:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.160504:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904256 00000100:00100000:0.0:1717018898.160611:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1717018898.160615:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819904256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.160680:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819904256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.160685:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:2.0:1717018898.160729:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.160746:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.160776:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.160782:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.160789:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904320 00000100:00100000:1.0:1717018898.160803:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:1.0:1717018898.160806:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819904320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018898.160988:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819904320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 181us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.160994:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1717018898.161027:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.161289:0:28350:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28350:1800422819904384:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018898.161313:0:28350:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.161346:0:28350:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.161356:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904384 00000100:00100000:1.0:1717018898.161378:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:1.0:1717018898.161381:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28350:x1800422819904384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018898.161595:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28350:x1800422819904384:12345-0@lo:502:llog_process_th.0 Request processed in 213us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.161600:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:3.0:1717018898.161669:0:28350:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28350:1800422819904384:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717018898.161689:0:28350:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717018898.161694:0:28350:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717018898.161696:0:28350:0:(obd_config.c:1460:class_process_config()) marker 71 (0x1) lustre-MDT0000-m add lustre.test_22d.lustre-OST0000_UUID 00000020:00000080:3.0:1717018898.161700:0:28350:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:3.0:1717018898.161709:0:28350:0:(lod_pool.c:614:lod_pool_add()) Added lustre-OST0000_UUID to test_22d as member 1 00000020:01000004:3.0:1717018898.161956:0:28351:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff880090828000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1717018898.161959:0:28351:0:(obd_mount.c:668:lustre_put_lsi()) put ffff880090828000 4 00000100:00100000:0.0:1717018898.161967:0:28350:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28350:1800422819904448:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.161993:0:28350:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.162012:0:28350:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008ab07840 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.162046:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904448 00000100:00100000:1.0:1717018898.162058:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:1.0:1717018898.162061:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28350:x1800422819904448:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018898.162209:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:28350:x1800422819904448:12345-0@lo:502:llog_process_th.0 Request processed in 147us (215us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.162215:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1717018898.162227:0:28350:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28350:1800422819904448:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1717018898.162240:0:28350:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717018898.162243:0:28350:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717018898.162243:0:28350:0:(obd_config.c:1460:class_process_config()) marker 71 (0x2) lustre-MDT0000-m add lustre.test_22d.lustre-OST0000_UUID 00000040:00080000:0.0:1717018898.162252:0:28350:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 108 count 106 00000020:01000000:2.0:1717018898.162299:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 105-107 (rc=0) 10000000:01000000:2.0:1717018898.162314:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1717018898.162317:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19c7 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.162333:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d2880/0x81e56358f42c19c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19c7 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018898.162340:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018898.162416:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 110 10000000:01000000:2.0:1717018898.162418:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018898.162431:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.162435:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.162441:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.162449:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.162474:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.162482:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.162519:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904512 00000100:00100000:1.0:1717018898.162541:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:1.0:1717018898.162543:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819904512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018898.162548:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018898.162556:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c19ce expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.162567:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c19ce expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.162572:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c19d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c19ce expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.162577:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79dd40, rc 0) 00000100:00100000:1.0:1717018898.162594:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819904512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 49us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.162601:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1717018898.162621:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.162632:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19d5 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.162638:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19d5 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.162663:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.162678:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.162684:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.162687:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904576 00000100:00100000:0.0:1717018898.162698:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1717018898.162701:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819904576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.162804:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819904576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 102us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.162808:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 00000100:00100000:2.0:1717018898.162852:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.162866:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.162964:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.162973:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.162999:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904640 00000100:00100000:0.0:1717018898.163018:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1121 00000100:00100000:0.0:1717018898.163021:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819904640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.163204:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819904640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.163209:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1121 00000100:00100000:2.0:1717018898.163264:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.163567:0:28352:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28352:1800422819904704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018898.163591:0:28352:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.163614:0:28352:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.163628:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904704 00000100:00100000:0.0:1717018898.163639:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1122 00000100:00100000:0.0:1717018898.163642:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:28352:x1800422819904704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.163861:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:28352:x1800422819904704:12345-0@lo:502:llog_process_th.0 Request processed in 218us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.163865:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1122 00000100:00100000:3.0:1717018898.163914:0:28352:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28352:1800422819904704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018898.163939:0:28352:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28352:1800422819904768:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717018898.163958:0:28352:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.163966:0:28352:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.163974:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904768 00000100:00100000:0.0:1717018898.163994:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1123 00000100:00100000:0.0:1717018898.163997:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:28352:x1800422819904768:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.164101:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:28352:x1800422819904768:12345-0@lo:502:llog_process_th.0 Request processed in 103us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.164105:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1123 00000100:00100000:3.0:1717018898.164153:0:28352:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28352:1800422819904768:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717018898.164166:0:28352:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 113 count 111 00000020:01000000:2.0:1717018898.164269:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 110-112 (rc=0) 10000000:01000000:2.0:1717018898.164283:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717018898.164287:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19d5 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.164293:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3600/0x81e56358f42c19ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19d5 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018898.164299:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1717018898.164301:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1717018898.164307:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1717018898.164319:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.164332:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.164337:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.164345:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.164363:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.164383:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.164527:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904832 00000100:00100000:0.0:1717018898.164546:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1124 00000100:00100000:0.0:1717018898.164549:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819904832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717018898.164554:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717018898.164562:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e0480/0x81e56358f42c19e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c19dc expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.164574:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e0480/0x81e56358f42c19e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c19dc expref: 15 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.164578:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e0480/0x81e56358f42c19e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c19dc expref: 15 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.164583:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e0480, rc 0) 00000100:00100000:0.0:1717018898.164960:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819904832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 409us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.164965:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1124 00000100:00100000:2.0:1717018898.165348:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.165357:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19e3 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.165367:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19e3 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.165396:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.165413:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.165467:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.165517:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904896 00000100:00100000:1.0:1717018898.165537:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1125 00000100:00100000:1.0:1717018898.165540:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819904896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018898.165602:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819904896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.165609:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018898.165615:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1125 00000100:00100000:2.0:1717018898.165625:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.165648:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.165654:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.165659:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819904960 00000100:00100000:1.0:1717018898.165669:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1126 00000100:00100000:1.0:1717018898.165672:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819904960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717018898.166016:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819904960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 342us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.166021:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1126 00000100:00100000:2.0:1717018898.166035:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819904960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717018898.166481:0:28353:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1717018898.166565:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1717018898.166579:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1717018898.166583:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19e3 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.166590:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1f80/0x81e56358f42c19dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19e3 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717018898.166596:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717018898.166597:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 110 10000000:01000000:2.0:1717018898.166599:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717018898.166610:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.166614:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.166619:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717018898.166626:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.166647:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018898.166668:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009a66e000 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.166716:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905024 00000100:00100000:1.0:1717018898.166731:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1127 00000100:00100000:1.0:1717018898.166734:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819905024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018898.166739:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018898.166746:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79d680/0x81e56358f42c19f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c19ea expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.166757:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79d680/0x81e56358f42c19f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c19ea expref: 16 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.166763:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79d680/0x81e56358f42c19f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c19ea expref: 16 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.166767:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79d680, rc 0) 00000100:00100000:1.0:1717018898.166787:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819905024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 53us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.166791:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1127 00000100:00100000:3.0:1717018898.167097:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296f6c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018898.167105:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19f1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018898.167111:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19f1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018898.167139:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.167166:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.167190:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.167234:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905088 00000100:00100000:2.0:1717018898.167318:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1128 00000100:00100000:2.0:1717018898.167321:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819905088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.167409:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819905088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.167413:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1128 00000100:00100000:3.0:1717018898.167462:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.167480:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.167503:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.167509:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.167546:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905152 00000100:00100000:2.0:1717018898.167558:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1129 00000100:00100000:2.0:1717018898.167560:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819905152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.167691:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819905152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.167696:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1129 00000100:00100000:3.0:1717018898.167752:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.168105:0:28354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28354:1800422819905216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.168136:0:28354:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.168143:0:28354:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093f716c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.168150:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905216 00000100:00100000:2.0:1717018898.168346:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1130 00000100:00100000:2.0:1717018898.168350:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:28354:x1800422819905216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717018898.168593:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:28354:x1800422819905216:12345-0@lo:502:llog_process_th.0 Request processed in 241us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.168598:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1130 00000100:00100000:0.0:1717018898.168697:0:28354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28354:1800422819905216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.168726:0:28354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28354:1800422819905280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717018898.168748:0:28354:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.168755:0:28354:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093f716c0 going to sleep for 6 seconds 00000100:00100000:1.0:1717018898.168795:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905280 00000100:00100000:1.0:1717018898.168815:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1131 00000100:00100000:1.0:1717018898.168818:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:28354:x1800422819905280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717018898.168972:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+16:28354:x1800422819905280:12345-0@lo:502:llog_process_th.0 Request processed in 153us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018898.168977:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1131 00000100:00100000:0.0:1717018898.169032:0:28354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:28354:1800422819905280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1717018898.169046:0:28354:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 113 count 111 00000020:01000000:3.0:1717018898.169211:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 110-112 (rc=0) 10000000:01000000:3.0:1717018898.169228:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1717018898.169233:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19f1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018898.169240:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c19ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19f1 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717018898.169246:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1717018898.169248:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:3.0:1717018898.169251:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1717018898.169264:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018898.169270:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018898.169275:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018898.169283:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.169311:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.169453:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.169502:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905344 00000100:00100000:2.0:1717018898.169527:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1132 00000100:00100000:2.0:1717018898.169531:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819905344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.169537:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018898.169546:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0900/0x81e56358f42c19ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c19f8 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.169559:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0900/0x81e56358f42c19ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c19f8 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.169569:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0900/0x81e56358f42c19ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c19f8 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.169575:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0900, rc 0) 00000100:00100000:2.0:1717018898.169606:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819905344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.169618:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1132 00000100:00100000:3.0:1717018898.169677:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717018898.169685:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19ff expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018898.169691:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c19ff expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717018898.169716:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.169732:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.169739:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.170629:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905408 00000100:00100000:2.0:1717018898.170659:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1133 00000100:00100000:2.0:1717018898.170662:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819905408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.170758:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819905408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.170763:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1133 00000100:00100000:3.0:1717018898.170910:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.170930:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717018898.170953:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018898.170960:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a60cc0c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717018898.171022:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905472 00000100:00100000:0.0:1717018898.171049:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1134 00000100:00100000:0.0:1717018898.171053:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819905472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.171203:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819905472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1717018898.171208:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1134 00000100:00100000:3.0:1717018898.171225:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092ac8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717018898.172031:0:28355:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:0.0:1717018898.172180:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1717018898.172197:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1717018898.172201:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19ff expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.172208:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff880134f1fcc0/0x81e56358f42c19f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c19ff expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717018898.172215:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717018898.172217:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:0.0:1717018898.172219:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717018898.172234:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.172240:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.172245:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018898.172255:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717018898.172279:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717018898.172373:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093f71000 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.172428:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905536 00000100:00100000:2.0:1717018898.172445:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1135 00000100:00100000:2.0:1717018898.172448:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819905536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.172454:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018898.172463:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1a0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c1a06 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.172477:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c1a06 expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.172482:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0000/0x81e56358f42c1a0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c1a06 expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.172487:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0000, rc 0) 00000100:00100000:2.0:1717018898.172637:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819905536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.172642:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1135 00000100:00100000:1.0:1717018898.172710:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800905884c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717018898.172719:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a0d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.172725:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c1a0d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717018898.172758:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717018898.172776:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018898.172783:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801349ccb40 going to sleep for 6 seconds 00000100:00100000:2.0:1717018898.172845:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905600 00000100:00100000:2.0:1717018898.172868:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:2.0:1717018898.172871:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819905600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.172935:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819905600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 63us (159us total) trans 0 rc -2/-2 00000100:00100000:2.0:1717018898.172940:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0:1717018898.173028:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819905600:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1717018898.173044:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1717018898.173046:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a0d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018898.173051:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c1a06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c1a0d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717018898.452517:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018898.769092:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.769173:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670656 00000100:00100000:2.0:1717018898.769221:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1137 00000100:00100000:2.0:1717018898.769226:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+7:4633:x1800422838670656:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.769239:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018898.769252:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d3180/0x81e56358f42c1a14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36793 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.769275:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d3180/0x81e56358f42c1a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36793 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.769283:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d3180/0x81e56358f42c1a14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36793 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.769289:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d3180, rc 0) 00000100:00100000:2.0:1717018898.769337:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670656:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 110us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.769343:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1137 00000100:00100000:0.0:1717018898.771684:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.771772:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670720 00000100:00100000:2.0:1717018898.771802:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1138 00000100:00100000:2.0:1717018898.771806:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670720:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.771955:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670720:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 148us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.771961:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1138 00000100:00100000:0.0:1717018898.773685:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.773741:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670784 00000100:00100000:2.0:1717018898.773775:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1139 00000100:00100000:2.0:1717018898.773779:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670784:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.773967:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670784:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 187us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.773974:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1139 00000100:00100000:0.0:1717018898.775586:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.775668:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670848 00000100:00100000:2.0:1717018898.775695:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1140 00000100:00100000:2.0:1717018898.775699:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:23309:x1800422838670848:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1717018898.775966:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:23309:x1800422838670848:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 266us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.775973:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1140 00000100:00100000:0.0:1717018898.777309:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.777453:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670912 00000100:00100000:2.0:1717018898.777484:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1141 00000100:00100000:2.0:1717018898.777488:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:23309:x1800422838670912:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1717018898.777686:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:23309:x1800422838670912:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 197us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.777692:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1141 00000100:00100000:0.0:1717018898.779852:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.779961:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838670976 00000100:00100000:2.0:1717018898.779989:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1142 00000100:00100000:2.0:1717018898.779994:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838670976:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717018898.780003:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717018898.780016:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1a1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3679a expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.780048:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3679a expref: 9 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.780055:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d3840/0x81e56358f42c1a1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3679a expref: 9 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018898.780061:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d3840, rc 0) 00000100:00100000:2.0:1717018898.780102:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838670976:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 108us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018898.780108:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1142 00000100:00100000:0.0:1717018898.781630:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018898.781678:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671040 00000100:00100000:2.0:1717018898.781711:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1143 00000100:00100000:2.0:1717018898.781716:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838671040:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717018898.781799:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838671040:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 82us (171us total) trans 0 rc -2/-2 00000100:00100000:2.0:1717018898.781804:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1143 00000100:00100000:2.0:1717018899.068214:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819905664:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068226:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819905728:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018899.068284:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819905856:0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018899.068344:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819905792:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068456:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717018899.068476:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800812984c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819905984:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068493:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018899.068505:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018899.068525:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819905920:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068533:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905728 00000100:00100000:2.0:1717018899.068543:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018899.068561:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905920 00000100:00100000:1.0:1717018899.068577:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905984 00000100:00100000:2.0:1717018899.068580:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1717018899.068584:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819905920:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068590:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 714 00000100:00100000:1.0:1717018899.068592:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008129aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819905728:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:1.0:1717018899.068603:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008129aac0 x1800422819905728/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:251/0 lens 224/224 e 0 to 0 dl 1717018986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:2.0:1717018899.068624:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296df00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819905920:12345-0@lo:400:kworker/u8:0.0 Request processed in 39us (80us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018899.068628:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008129aac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819905728:12345-0@lo:400:kworker/u8:0.0 Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018899.068633:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 714 00000100:00100000:2.0:1717018899.068641:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1717018899.068645:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1717018899.068647:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133075f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819905984:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:1.0:1717018899.068655:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880133075f00 x1800422819905984/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:251/0 lens 224/224 e 0 to 0 dl 1717018986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:2.0:1717018899.068672:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819905920:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068672:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133075f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819905984:12345-0@lo:400:kworker/u8:0.0 Request processed in 23us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018899.068676:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 715 00000100:00100000:1.0:1717018899.068698:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819905728:0@lo:400:kworker/u8:0.0 00000100:00100000:1.0:1717018899.068704:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800812984c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819905984:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018899.068705:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905664 00000100:00100000:2.0:1717018899.068727:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1717018899.068731:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819905664:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018899.068755:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819905664:12345-0@lo:400:kworker/u8:0.0 Request processed in 24us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018899.068759:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1717018899.068780:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819905664:0@lo:400:kworker/u8:0.0 00000100:00100000:3.0:1717018899.068788:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717018899.068799:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905856 00000100:00100000:2.0:1717018899.068812:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1717018899.068815:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819905856:12345-0@lo:400:kworker/u8:0.0 00000100:00100000:0.0:1717018899.068873:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717018899.069050:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819905792 00000100:00100000:3.0:1717018899.069068:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 716 00000100:00100000:3.0:1717018899.069071:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819905792:12345-0@lo:400:kworker/u8:0.0 00010000:00000080:3.0:1717018899.069079:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009058ed40 x1800422819905792/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:251/0 lens 224/224 e 0 to 0 dl 1717018986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:0.0' 00000100:00100000:3.0:1717018899.069114:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819905792:12345-0@lo:400:kworker/u8:0.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1717018899.069119:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 716 00000100:00100000:0.0:1717018899.069161:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819905792:0@lo:400:kworker/u8:0.0 00000100:00100000:2.0:1717018899.069175:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092ac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819905856:12345-0@lo:400:kworker/u8:0.0 Request processed in 357us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018899.069180:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:3.0:1717018899.069209:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539da40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819905856:0@lo:400:kworker/u8:0.0 00010000:00010000:3.0:1717018899.454490:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717018899.645820:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018899.647042:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671104 00000100:00100000:1.0:1717018899.647094:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 352 00000100:00100000:1.0:1717018899.647099:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+63:23320:x1800422838671104:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1717018899.647114:0:8254:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018899.647128:0:8254:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79df80/0x81e56358f42c1a22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a367a1 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647166:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647183:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647191:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647199:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647204:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647207:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647330:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c000/0x81e56358f42c1a37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647336:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c000/0x81e56358f42c1a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647340:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c000/0x81e56358f42c1a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1717018899.647363:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cf0:0x0]: returning size 11776 00000004:00200000:1.0:1717018899.647366:0:8254:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1717018899.647376:0:8254:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c000/0x81e56358f42c1a37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647383:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647390:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647394:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647399:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79cfc0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018899.647401:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647405:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647414:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:1.0:1717018899.647416:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018899.647418:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647422:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c1a29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647453:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647457:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647461:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647471:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79fa80 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018899.647473:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647476:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647481:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9516acfe (ffff880132059500) 00010000:00010000:1.0:1717018899.647483:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018899.647484:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647487:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647506:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79df80/0x81e56358f42c1a22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367a1 expref: 65 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647514:0:8254:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c000/0x81e56358f42c1a37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367a1 expref: 64 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.647518:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf0:0x0].0x0 (ffff880132059e00) 00010000:00010000:1.0:1717018899.647519:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1717018899.647520:0:8254:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79c000, rc 0) 00010000:00000080:1.0:1717018899.647525:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880090588000 x1800422838671104/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:244/0 lens 584/640 e 0 to 0 dl 1717018979 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:1.0:1717018899.647573:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090588000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+64:23320:x1800422838671104:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 473us (1758us total) trans 0 rc 0/0 00000100:00100000:1.0:1717018899.647584:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 352 00000100:00100000:0.0:1717018899.649966:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018899.650030:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671168 00000100:00100000:3.0:1717018899.650074:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 353 00000100:00100000:3.0:1717018899.650079:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+64:23320:x1800422838671168:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:3.0:1717018899.650092:0:9645:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717018899.650104:0:9645:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f3c0/0x81e56358f42c1a3e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a367a8 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650146:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650155:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650162:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650170:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650174:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650178:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650244:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650249:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650253:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650257:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880134f1f180 already unused, calling callback (ffffffffa1346360) 00010000:00010000:3.0:1717018899.650259:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650264:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650271:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf0:0x0].0x0 (ffff880132059e00) 00010000:00010000:3.0:1717018899.650273:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1717018899.650275:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650278:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f180/0x81e56358f42c1a45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650300:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650304:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650325:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650329:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880134f1fa80 already unused, calling callback (ffffffffa1346360) 00010000:00010000:3.0:1717018899.650330:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650334:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650339:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf0:0x0].0x9516ad10 (ffff88008b46bb00) 00010000:00010000:3.0:1717018899.650341:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1717018899.650342:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650345:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1fa80/0x81e56358f42c1a4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650375:0:9645:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f3c0/0x81e56358f42c1a3e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367a8 expref: 65 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650381:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880134f1f3c0/0x81e56358f42c1a3e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367a8 expref: 65 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717018899.650386:0:9645:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880134f1f3c0, rc 0) 00010000:00000080:3.0:1717018899.650389:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009058df00 x1800422838671168/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:244/0 lens 584/640 e 0 to 0 dl 1717018979 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:3.0:1717018899.650424:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+64:23320:x1800422838671168:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 346us (463us total) trans 0 rc 301/301 00000100:00100000:3.0:1717018899.650434:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 353 00000100:00100000:0.0:1717018899.652007:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018899.652219:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671296 00000100:00100000:1.0:1717018899.652446:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 354 00000100:00100000:1.0:1717018899.652450:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+64:23320:x1800422838671296:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1717018899.652463:0:8254:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018899.652464:0:8254:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1717018899.652480:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c000/0x81e56358f42c1a37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367a1 expref: 64 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652576:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf0:0x0].0x0 (ffff880132059e00) 00010000:00010000:1.0:1717018899.652585:0:8254:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717018899.652593:0:8254:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cb40/0x81e56358f42c1a53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a367af expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652680:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652686:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652692:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652698:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652702:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.652716:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653880:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653889:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653896:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1717018899.653904:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cf1:0x0]: returning size 0 00010000:00010000:1.0:1717018899.653922:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653927:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653931:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653936:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79c480 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018899.653938:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653942:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653950:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf0:0x0].0x0 (ffff880132059f00) 00010000:00010000:1.0:1717018899.653958:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717018899.653960:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653964:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c480/0x81e56358f42c1a5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1717018899.653973:0:8254:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88009058cc00 reply state ffff88008b4b6000 transno 12884902032 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.653993:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cb40/0x81e56358f42c1a53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 66 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.654003:0:8254:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 65 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.654007:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf1:0x0].0x0 (ffff880132059400) 00010000:00010000:1.0:1717018899.654008:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1717018899.654009:0:8254:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79c900, rc 0) 00010000:00000080:1.0:1717018899.654013:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009058cc00 x1800422838671296/t12884902032(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:244/0 lens 528/600 e 0 to 0 dl 1717018979 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:1.0:1717018899.654069:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+66:23320:x1800422838671296:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1618us (2065us total) trans 12884902032 rc 0/0 00000100:00100000:1.0:1717018899.654075:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 354 00010000:00010000:2.0:1717018899.655599:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.655609:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.655613:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.655617:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79e1c0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:2.0:1717018899.655619:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.655631:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.655642:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf0:0x0].0x9516ad10 (ffff880132059000) 00010000:00010000:2.0:1717018899.655643:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1717018899.655645:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.655650:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79e1c0/0x81e56358f42c1a61 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2cf0:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018899.656204:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717018899.656338:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671424 00000100:00100000:1.0:1717018899.656378:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 355 00000100:00100000:1.0:1717018899.656383:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090588980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+65:23320:x1800422838671424:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:1.0:1717018899.656399:0:8254:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717018899.656419:0:8254:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79df80/0x81e56358f42c1a76 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a367b6 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.656481:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.656491:0:8254:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 66 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.656497:0:8254:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.656519:0:8254:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 66 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.656526:0:8254:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 66 pid: 8254 timeout: 2032 lvb_type: 0 00000100:00100000:1.0:1717018899.656533:0:8254:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801330763c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:8254:1800422819906048:192.168.203.26@tcp:104: 00000100:00100000:1.0:1717018899.656569:0:8254:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801361a7780 going to sleep for 6 seconds 00000100:00100000:1.0:1717018899.657489:0:8254:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801330763c0 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:8254:1800422819906048:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717018899.657502:0:8254:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717018899.657754:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717018899.657887:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671488 00010000:00010000:2.0:1717018899.657905:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 67 pid: 8254 timeout: 2032 lvb_type: 0 00000100:00100000:2.0:1717018899.657932:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75391 00000100:00100000:2.0:1717018899.657936:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:12cff408-c572-49fa-81b0-09052c8e7f41+67:1834:x1800422838671488:12345-192.168.203.26@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1717018899.657944:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717018899.657948:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 67 pid: 8254 timeout: 2032 lvb_type: 0 00010000:00010000:2.0:1717018899.657955:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 67 pid: 8254 timeout: 2032 lvb_type: 0 00010000:00010000:2.0:1717018899.657967:0:14966:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c900/0x81e56358f42c1a68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf1:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367af expref: 67 pid: 8254 timeout: 2032 lvb_type: 0 00010000:00010000:2.0:1717018899.657977:0:14966:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf1:0x0].0x0 (ffff880132059400) 00010000:00010000:2.0:1717018899.657985:0:14966:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.657991:0:14966:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.657996:0:14966:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717018899.658022:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717018899.658057:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:12cff408-c572-49fa-81b0-09052c8e7f41+66:1834:x1800422838671488:12345-192.168.203.26@tcp:103:ldlm_bl_02.0 Request processed in 120us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1717018899.658063:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75391 00010000:00010000:1.0:1717018899.658117:0:8254:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658123:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1717018899.658143:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cf1:0x0]: returning size 0 00010000:00010000:1.0:1717018899.658216:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658222:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658226:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658230:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79fa80 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717018899.658233:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658237:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658244:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cf1:0x0].0x0 (ffff880132059400) 00010000:00010000:1.0:1717018899.658245:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1717018899.658247:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658251:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79fa80/0x81e56358f42c1a7d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2cf1:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658276:0:8254:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79df80/0x81e56358f42c1a76 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367b6 expref: 65 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658282:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79df80/0x81e56358f42c1a76 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cf0:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a367b6 expref: 65 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717018899.658295:0:8254:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79df80, rc 0) 00010000:00000080:1.0:1717018899.658300:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880090588980 x1800422838671424/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:244/0 lens 1104/600 e 0 to 0 dl 1717018979 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:1.0:1717018899.658346:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090588980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+64:23320:x1800422838671424:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1964us (2145us total) trans 0 rc 301/301 00000100:00100000:1.0:1717018899.658352:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 355 00000100:00100000:0.0:1717018899.659574:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717018899.659659:0:17005:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838671616 00000100:00100000:3.0:1717018899.660113:0:17005:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 53 00000100:00100000:3.0:1717018899.660118:0:17005:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e5d8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12cff408-c572-49fa-81b0-09052c8e7f41+64:23320:x1800422838671616:12345-192.168.203.26@tcp:35:lfs.0 00010000:00000080:3.0:1717018899.660309:0:17005:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012e5d8850 x1800422838671616/t12884902033(0) o35->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:170/0 lens 392/456 e 0 to 0 dl 1717018905 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:3.0:1717018899.660530:0:17005:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e5d8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:12cff408-c572-49fa-81b0-09052c8e7f41+65:23320:x1800422838671616:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 411us (958us total) trans 12884902033 rc 0/0 00000100:00100000:3.0:1717018899.660535:0:17005:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 53 00000400:00000080:2.0:1717018900.266338:0:28490:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:2.0:1717018900.266342:0:28490:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22d: @@@@@@ FAIL: Create /mnt/lustre/d22d.sanity-pfl/f22d.sanity-pfl failed 00010000:00010000:0.0:1717018900.456762:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 4580 lines, 4580 kept, 0 dropped, 0 bad.