00010000:00010000:0.0F:1717019063.801968:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019064.332542:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a69c3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819943744:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019064.332594:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019064.332615:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1717019064.332619:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a69c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819943680:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019064.332638:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019064.332666:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943744 00000100:00100000:0.0:1717019064.332692:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1136 00000100:00100000:0.0:1717019064.332695:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819943744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019064.332727:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3f200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819943744:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019064.332732:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1136 00000100:00100000:1.0F:1717019064.332757:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a69c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819943552:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019064.332758:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a69c3dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819943744:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019064.332800:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019064.332813:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a69c0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819943808:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0F:1717019064.332817:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a69c50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819943616:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019064.332847:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019064.332859:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019064.332871:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819943872:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019064.332874:0:8489:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943680 00000100:00100000:2.0:1717019064.332881:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019064.332894:0:8489:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943616 00000100:00100000:2.0:1717019064.332898:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943872 00000100:00100000:1.0:1717019064.332905:0:8489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 846 00000100:00100000:1.0:1717019064.332908:0:8489:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819943680:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019064.332913:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 847 00000100:00100000:2.0:1717019064.332916:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819943616:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:1.0:1717019064.332919:0:8489:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880130f3c740 x1800422819943680/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:409/0 lens 224/224 e 0 to 0 dl 1717019144 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00010000:00000080:2.0:1717019064.332924:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013714cc00 x1800422819943616/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:409/0 lens 224/224 e 0 to 0 dl 1717019144 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717019064.332943:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714cc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819943616:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (85us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019064.332943:0:8489:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3c740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819943680:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019064.332947:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 847 00000100:00100000:1.0:1717019064.332949:0:8489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 846 00000100:00100000:2.0:1717019064.332955:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1717019064.332957:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819943872:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:2.0:1717019064.332962:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013714a600 x1800422819943872/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:409/0 lens 224/224 e 0 to 0 dl 1717019144 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1717019064.332973:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a69c17c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819943680:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019064.332974:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714a600 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819943872:12345-0@lo:400:kworker/u8:2.0 Request processed in 17us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019064.332978:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 848 00000100:00100000:2.0:1717019064.332991:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943552 00000100:00100000:2.0:1717019064.333002:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1493 00000100:00100000:2.0:1717019064.333005:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819943552:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019064.333028:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2854:x1800422819943552:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019064.333032:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1493 00000100:00100000:2.0:1717019064.333051:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a69c50c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819943616:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019064.333063:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3df00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819943872:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019064.333116:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819943808 00000100:00100000:0.0:1717019064.333129:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1137 00000100:00100000:0.0:1717019064.333131:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132eff6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819943808:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019064.333149:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132eff6c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819943808:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019064.333153:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1137 00000100:00100000:1.0:1717019064.333279:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a69c5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:627fc11f-491c-4f89-ad31-986408f4a526:2854:1800422819943552:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019064.333287:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a69c0980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819943808:0@lo:400:kworker/u8:2.0 00010000:00010000:2.0:1717019064.803948:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1717019065.099962:0:2228:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1717019065.099970:0:2228:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1717019065.099973:0:2228:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1717019065.100302:0:2228:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1717019065.100309:0:2228:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1717019065.100338:0:2228:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_23e.lustre-OST0000_UUID fl=4 20000000:01000000:3.0F:1717019065.101047:0:2229:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 129 marker 87 1->4: lustre-MDT0000-mdtlov add lustre.test_23e.lustre-OST0000_UUID 20000000:01000000:3.0:1717019065.101207:0:2229:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 131 marker 87 2->4: lustre-MDT0000-mdtlov add lustre.test_23e.lustre-OST0000_UUID 00000040:00080000:3.0:1717019065.101230:0:2229:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 132 count 130 00000040:00080000:1.0:1717019065.101503:0:2228:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].133, 224 off32992 20000000:01000000:1.0:1717019065.101512:0:2228:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_23e lustre-OST0000_UUID (null) 00000040:00080000:1.0:1717019065.101546:0:2228:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].134, 144 off33136 00000040:00080000:1.0:1717019065.101601:0:2228:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].135, 224 off33360 20000000:01000000:1.0:1717019065.101922:0:2228:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_23e.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1717019065.102527:0:2230:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 135 marker 88 1->4: lustre-clilov add lustre.test_23e.lustre-OST0000_UUID 20000000:01000000:3.0:1717019065.102586:0:2230:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 137 marker 88 2->4: lustre-clilov add lustre.test_23e.lustre-OST0000_UUID 00000040:00080000:3.0:1717019065.102616:0:2230:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 138 count 135 00000040:00080000:1.0:1717019065.102860:0:2228:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].138, 224 off33800 20000000:01000000:1.0:1717019065.102875:0:2228:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce022 lustre test_23e lustre-OST0000_UUID (null) 00000040:00080000:1.0:1717019065.102921:0:2228:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].139, 136 off33936 00000040:00080000:1.0:1717019065.102959:0:2228:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].140, 224 off34160 10000000:01000000:1.0:1717019065.102969:0:2228:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1717019065.102982:0:2228:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.102995:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2049 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.102999:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2057 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103003:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2065 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103007:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2073 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103011:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2081 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103015:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c208f expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103019:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c209d expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103025:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103030:0:2228:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103043:0:2228:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103071:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103079:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 8 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103087:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132ef8e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819943936:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717019065.103146:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 8 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103150:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 8 pid: 8249 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103153:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132efd0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944000:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717019065.103165:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c209d expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103168:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c209d expref: 17 pid: 8249 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103172:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008696da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944064:0@lo:104: 00000100:00100000:1.0:1717019065.103210:0:2228:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717019065.103236:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c208f expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103242:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c208f expref: 17 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103253:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008e9acc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944128:0@lo:104: 00000100:00100000:0.0:1717019065.103258:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944064 00000100:00100000:1.0:1717019065.103266:0:2228:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019065.103283:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944128 00000100:00100000:1.0:1717019065.103286:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1717019065.103290:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9adf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944064:12345-0@lo:104: 00000100:00100000:0.0:1717019065.103302:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1717019065.103305:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9af200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944128:12345-0@lo:104: 00010000:00010000:1.0:1717019065.103318:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1717019065.103321:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9adf00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944064:12345-0@lo:104: Request processed in 32us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019065.103326:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00010000:00010000:0.0:1717019065.103326:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1717019065.103328:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9af200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944128:12345-0@lo:104: Request processed in 23us (62us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019065.103331:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00010000:00010000:2.0:1717019065.103342:0:6619:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1717019065.103344:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2081 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103346:0:6619:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103346:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1717019065.103349:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103350:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2081 expref: 17 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103351:0:6619:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0000 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717019065.103353:0:6619:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103354:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1200 already unused, calling callback (ffffffffa02815c0) 00000100:00100000:1.0:1717019065.103355:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d876c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944192:0@lo:104: 10000000:00010000:0.0:1717019065.103355:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103357:0:6619:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1717019065.103359:0:6619:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103360:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019065.103362:0:6619:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1717019065.103364:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019065.103368:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1717019065.103370:0:2228:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717019065.103381:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2073 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103386:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2073 expref: 17 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103387:0:6619:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103387:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103392:0:6619:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1717019065.103392:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d817c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944256:0@lo:104: 00010000:00010000:0.0:1717019065.103392:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717019065.103406:0:6619:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103406:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019065.103410:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819944320:0@lo:103:ldlm_bl_01.0 00000100:00100000:1.0:1717019065.103410:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819944384:0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1717019065.103411:0:6619:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d0000/0x81e56358f42c209d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c20a4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103411:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1200/0x81e56358f42c208f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2096 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103418:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019065.103419:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.103419:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.103420:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019065.103421:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.103421:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019065.103428:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019065.103430:0:6615:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1717019065.103435:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019065.103441:0:6615:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019065.103451:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944384 00000100:00100000:2.0:1717019065.103452:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944320 00000100:00100000:0.0:1717019065.103458:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944192 00010000:00010000:1.0:1717019065.103462:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c208f expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103467:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c209d expref: 19 pid: 8249 timeout: 2198 lvb_type: 0 00000100:00100000:0.0:1717019065.103467:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944256 00000100:00100000:0.0:1717019065.103476:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1717019065.103479:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75469 00000100:00100000:0.0:1717019065.103481:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944192:12345-0@lo:104: 00000100:00100000:1.0:1717019065.103482:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013702f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819944384:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019065.103483:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75470 00000100:00100000:2.0:1717019065.103486:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2357200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819944320:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:1.0:1717019065.103488:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717019065.103490:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c208f expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103492:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019065.103494:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c209d expref: 19 pid: 8249 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.103496:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c208f expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103501:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c209d expref: 19 pid: 8249 timeout: 2198 lvb_type: 0 00010000:00010000:0.0:1717019065.103501:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1717019065.103504:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944192:12345-0@lo:104: Request processed in 22us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019065.103508:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00010000:00010000:1.0:1717019065.103515:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717019065.103516:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1717019065.103534:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013702f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819944384:12345-0@lo:103:ldlm_bl_03.0 Request processed in 51us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019065.103535:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2357200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819944320:12345-0@lo:103:ldlm_bl_01.0 Request processed in 49us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019065.103539:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75469 00000100:00100000:0.0:1717019065.103539:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1717019065.103541:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75470 00000100:00100000:0.0:1717019065.103541:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:2228:x1800422819944256:12345-0@lo:104: 00000100:00100000:3.0:1717019065.103546:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819944320:0@lo:103:ldlm_bl_01.0 00010000:00010000:0.0:1717019065.103557:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1717019065.103560:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:2228:x1800422819944256:12345-0@lo:104: Request processed in 18us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019065.103563:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00010000:00010000:0.0:1717019065.103571:0:12712:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1717019065.103573:0:12712:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019065.103577:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3ed40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819944384:0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1717019065.103578:0:12712:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79df80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:0.0:1717019065.103579:0:12712:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103583:0:12712:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103590:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2065 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103596:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2065 expref: 17 pid: 8248 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103602:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a6d85a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944448:0@lo:104: 00000100:00100000:1.0:1717019065.103616:0:2228:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717019065.103630:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2057 expref: 17 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103635:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2057 expref: 17 pid: 8248 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103639:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d6880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944512:0@lo:104: 00000100:00100000:2.0:1717019065.103657:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944448 00000100:00100000:1.0:1717019065.103657:0:2228:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019065.103682:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944512 00000100:00100000:1.0:1717019065.103685:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1717019065.103688:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944448:12345-0@lo:104: 10000000:00010000:0.0:1717019065.103689:0:12712:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019065.103693:0:12712:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1717019065.103695:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:2.0:1717019065.103698:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d50c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944512:12345-0@lo:104: 00010000:00010000:0.0:1717019065.103705:0:12712:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103708:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1717019065.103709:0:12712:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1717019065.103711:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d3900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:2228:x1800422819944448:12345-0@lo:104: Request processed in 22us (95us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019065.103715:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00010000:00010000:2.0:1717019065.103722:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:0.0:1717019065.103722:0:12712:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103725:0:6620:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1717019065.103726:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d50c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:2228:x1800422819944512:12345-0@lo:104: Request processed in 28us (68us total) trans 0 rc 0/0 00010000:00010000:0.0:1717019065.103726:0:12712:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79df80/0x81e56358f42c2081 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2088 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103727:0:6620:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019065.103730:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1717019065.103730:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00010000:00010000:1.0:1717019065.103731:0:6620:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e0240 already unused, calling callback (ffffffffa02815c0) 00010000:00010000:0.0:1717019065.103732:0:12712:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:1.0:1717019065.103733:0:6620:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103733:0:12712:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103737:0:6620:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103737:0:12712:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e2d00 already unused, calling callback (ffffffffa02815c0) 00000100:00100000:3.0:1717019065.103738:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819944576:0@lo:103:ldlm_bl_06.0 10000000:00010000:0.0:1717019065.103738:0:12712:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717019065.103740:0:6620:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.103742:0:12712:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717019065.103744:0:6620:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717019065.103745:0:14979:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1717019065.103745:0:12712:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103748:0:14979:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103753:0:14979:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e2880 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717019065.103754:0:14979:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103754:0:6620:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019065.103755:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717019065.103758:0:6620:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717019065.103761:0:6620:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019065.103763:0:14979:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103765:0:6620:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e0240/0x81e56358f42c2073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c207a expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019065.103767:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819944640:0@lo:103:ldlm_bl_02.0 10000000:00010000:2.0:1717019065.103767:0:14979:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019065.103771:0:14979:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1717019065.103779:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1717019065.103780:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019065.103781:0:14979:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103781:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019065.103782:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019065.103785:0:14979:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717019065.103792:0:2228:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2049 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019065.103797:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944576 00010000:00010000:2.0:1717019065.103799:0:14979:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.103799:0:2228:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2049 expref: 18 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103803:0:14979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e2880/0x81e56358f42c2057 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c205e expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019065.103805:0:2228:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944768:0@lo:104: 00010000:00010000:3.0:1717019065.103809:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2081 expref: 18 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.103809:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:2.0:1717019065.103810:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019065.103811:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019065.103812:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019065.103814:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819944704:0@lo:103:ldlm_bl_04.0 00000100:00100000:3.0:1717019065.103819:0:10751:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944640 00000100:00100000:2.0:1717019065.103820:0:11917:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75471 00000100:00100000:2.0:1717019065.103823:0:11917:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2356880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:627fc11f-491c-4f89-ad31-986408f4a526+19:2855:x1800422819944576:12345-0@lo:103:ldlm_bl_06.0 00010000:00010000:3.0:1717019065.103838:0:10751:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2073 expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103844:0:11917:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019065.103846:0:11917:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2081 expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:3.0:1717019065.103848:0:10751:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75472 00000100:00100000:1.0:1717019065.103849:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019065.103851:0:10751:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2354740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+19:2855:x1800422819944640:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:2.0:1717019065.103851:0:11917:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2081 expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:3.0:1717019065.103855:0:10751:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717019065.103857:0:10751:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2073 expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.103858:0:11917:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1717019065.103866:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944704 00010000:00010000:3.0:1717019065.103868:0:10751:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2073 expref: 19 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:3.0:1717019065.103874:0:10751:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717019065.103875:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2057 expref: 20 pid: 8248 timeout: 2198 lvb_type: 0 00000100:00100000:2.0:1717019065.103879:0:11917:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2356880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819944576:12345-0@lo:103:ldlm_bl_06.0 Request processed in 56us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019065.103884:0:11917:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75471 00000100:00100000:3.0:1717019065.103885:0:10751:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2354740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:627fc11f-491c-4f89-ad31-986408f4a526+20:2855:x1800422819944640:12345-0@lo:103:ldlm_bl_02.0 Request processed in 34us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019065.103889:0:10751:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75472 00000100:00100000:1.0:1717019065.103895:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75473 00000100:00100000:1.0:1717019065.103898:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819944704:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1717019065.103903:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717019065.103905:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2057 expref: 18 pid: 8248 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.103909:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2057 expref: 18 pid: 8248 timeout: 2198 lvb_type: 0 10000000:01000000:0.0:1717019065.103909:0:12712:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1717019065.103914:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d4280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819944640:0@lo:103:ldlm_bl_02.0 00010000:00010000:1.0:1717019065.103915:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717019065.103919:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819944576:0@lo:103:ldlm_bl_06.0 00000100:00100000:1.0:1717019065.103931:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819944704:12345-0@lo:103:ldlm_bl_04.0 Request processed in 33us (83us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019065.103942:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75473 00000100:00100000:1.0:1717019065.103965:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714aac0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819944704:0@lo:103:ldlm_bl_04.0 00000100:00100000:1.0:1717019065.103985:0:2228:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019065.103992:0:2228:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0a80 going to sleep for 6 seconds 00000100:00100000:2.0:1717019065.103993:0:6615:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944768 00010000:00010000:1.0:1717019065.104000:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79c000/0x81e56358f42c20a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c209d expref: 17 pid: 8249 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104008:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008696da40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944064:0@lo:104: 00000100:00100000:2.0:1717019065.104009:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1717019065.104011:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:2228:x1800422819944768:12345-0@lo:104: 00010000:00010000:2.0:1717019065.104039:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1717019065.104042:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d4280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+3:2228:x1800422819944768:12345-0@lo:104: Request processed in 30us (57us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019065.104046:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00010000:3.0:1717019065.104062:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1717019065.104065:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019065.104071:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e21c0 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717019065.104073:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019065.104077:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019065.104080:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019065.104084:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019065.104097:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.104100:0:12712:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019065.104101:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1717019065.104106:0:12712:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019065.104109:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019065.104111:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819944832:0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717019065.104113:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e21c0/0x81e56358f42c2049 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2050 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.104115:0:12712:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.104120:0:12712:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c2065 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c206c expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.104126:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.104127:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019065.104129:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1717019065.104130:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019065.104131:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019065.104132:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.104133:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019065.104137:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019065.104145:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1717019065.104149:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819944896:0@lo:103:ldlm_bl_06.0 00000100:00100000:2.0:1717019065.104163:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019065.104183:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944832 00000100:00100000:3.0:1717019065.104188:0:10306:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944896 00010000:00010000:1.0:1717019065.104192:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2049 expref: 18 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:3.0:1717019065.104198:0:10306:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2065 expref: 18 pid: 8248 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104206:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75474 00000100:00100000:1.0:1717019065.104209:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137149300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819944832:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019065.104210:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75475 00000100:00100000:2.0:1717019065.104213:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819944896:12345-0@lo:103:ldlm_bl_06.0 00010000:00010000:1.0:1717019065.104214:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717019065.104216:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2049 expref: 18 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.104219:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019065.104222:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2065 expref: 18 pid: 8248 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.104222:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2049 expref: 18 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:2.0:1717019065.104230:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2065 expref: 18 pid: 8248 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.104242:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717019065.104246:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1717019065.104262:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137149300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819944832:12345-0@lo:103:ldlm_bl_03.0 Request processed in 52us (132us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019065.104264:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819944896:12345-0@lo:103:ldlm_bl_06.0 Request processed in 51us (101us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019065.104266:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75474 00000100:00100000:2.0:1717019065.104269:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75475 00000100:00100000:3.0:1717019065.104274:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819944832:0@lo:103:ldlm_bl_03.0 00010000:00010000:1.0:1717019065.104284:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1e880/0x81e56358f42c2096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c208f expref: 16 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:2.0:1717019065.104287:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3c280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819944896:0@lo:103:ldlm_bl_06.0 00000100:00100000:1.0:1717019065.104290:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008e9acc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944128:0@lo:104: 00010000:00010000:1.0:1717019065.104301:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d1b00/0x81e56358f42c2088 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2081 expref: 15 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104306:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6d876c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944192:0@lo:104: 00010000:00010000:1.0:1717019065.104310:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d3600/0x81e56358f42c207a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2073 expref: 14 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104317:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6d817c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944256:0@lo:104: 00010000:00010000:1.0:1717019065.104321:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79cfc0/0x81e56358f42c206c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2065 expref: 13 pid: 8248 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104325:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a6d85a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944448:0@lo:104: 00010000:00010000:1.0:1717019065.104330:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d1f80/0x81e56358f42c205e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2057 expref: 12 pid: 8248 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104335:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d6880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944512:0@lo:104: 00010000:00010000:1.0:1717019065.104339:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d2d00/0x81e56358f42c2050 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2049 expref: 11 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104344:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944768:0@lo:104: 00000100:00100000:1.0:1717019065.104391:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132ef8e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819943936:192.168.203.26@tcp:104: 00000100:00100000:1.0:1717019065.104398:0:2228:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132efd0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2228:1800422819944000:192.168.203.26@tcp:104: 00010000:00010000:1.0:1717019065.104509:0:2228:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019065.104727:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019065.104758:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019065.104787:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689088 00010000:00010000:0.0:1717019065.104816:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 9 pid: 8249 timeout: 2198 lvb_type: 0 00000100:00100000:1.0:1717019065.104817:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689024 00010000:00010000:1.0:1717019065.104850:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 10 pid: 8250 timeout: 2198 lvb_type: 0 00000100:00100000:0.0:1717019065.104872:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75476 00000100:00100000:1.0:1717019065.104877:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75477 00000100:00100000:0.0:1717019065.104878:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+10:1834:x1800422838689088:12345-192.168.203.26@tcp:103:ldlm_bl_05.0 00000100:00100000:1.0:1717019065.104881:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:461e9689-0dac-4669-87c3-00abdddc539f+10:1833:x1800422838689024:12345-192.168.203.26@tcp:103:ldlm_bl_05.0 00010000:00010000:1.0:1717019065.104889:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717019065.104890:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717019065.104891:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 10 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:0.0:1717019065.104894:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 10 pid: 8249 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.104897:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 10 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:0.0:1717019065.104905:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 10 pid: 8249 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.105024:0:14966:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880134f1eac0/0x81e56358f42c20b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368dc expref: 10 pid: 8250 timeout: 2198 lvb_type: 0 00010000:00010000:0.0:1717019065.105029:0:6616:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79cb40/0x81e56358f42c20ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368d5 expref: 10 pid: 8249 timeout: 2198 lvb_type: 0 00010000:00010000:1.0:1717019065.105033:0:14966:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105038:0:14966:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.105044:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1717019065.105048:0:14966:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105052:0:14966:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105056:0:14966:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105060:0:14966:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105064:0:14966:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79c6c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:1.0:1717019065.105070:0:14966:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105075:0:14966:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019065.105079:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6dd1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+8:1834:x1800422838689088:12345-192.168.203.26@tcp:103:ldlm_bl_05.0 Request processed in 202us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019065.105083:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75476 00010000:00010000:1.0:1717019065.105084:0:14966:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105090:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1717019065.105112:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:461e9689-0dac-4669-87c3-00abdddc539f+7:1833:x1800422838689024:12345-192.168.203.26@tcp:103:ldlm_bl_05.0 Request processed in 230us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019065.105118:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75477 00010000:00010000:1.0:1717019065.105131:0:2228:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105136:0:2228:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019065.105140:0:2228:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c79c6c0/0x81e56358f42c211b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2228 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019065.806068:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019066.603193:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.603253:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689152 00000100:00100000:2.0:1717019066.603287:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1494 00000100:00100000:2.0:1717019066.603290:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+7:4633:x1800422838689152:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019066.603301:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019066.603313:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a368ff expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019066.603331:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019066.603338:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019066.603343:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0240, rc 0) 00000100:00100000:2.0:1717019066.603377:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689152:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 85us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019066.603382:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1494 00000100:00100000:0.0:1717019066.604453:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.604621:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689216 00000100:00100000:2.0:1717019066.604653:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1495 00000100:00100000:2.0:1717019066.604657:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689216:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019066.604809:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689216:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 152us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019066.604815:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1495 00000100:00100000:0.0:1717019066.606468:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.606536:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689280 00000100:00100000:2.0:1717019066.606576:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1496 00000100:00100000:2.0:1717019066.606581:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689280:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019066.606808:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689280:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 226us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019066.606815:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1496 00000100:00100000:0.0:1717019066.608202:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.608289:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689344 00000100:00100000:2.0:1717019066.608326:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1497 00000100:00100000:2.0:1717019066.608330:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:28367:x1800422838689344:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1717019066.608729:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:28367:x1800422838689344:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 397us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019066.608735:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1497 00000100:00100000:0.0:1717019066.610046:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.610107:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689408 00000100:00100000:2.0:1717019066.610148:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1498 00000100:00100000:2.0:1717019066.610153:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:28367:x1800422838689408:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:2.0:1717019066.610366:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:28367:x1800422838689408:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 211us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019066.610372:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1498 00000100:00100000:0.0:1717019066.611539:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.611601:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689472 00000100:00100000:2.0:1717019066.611653:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1499 00000100:00100000:2.0:1717019066.611658:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689472:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019066.611682:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019066.611696:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36906 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019066.611717:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 9 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019066.611725:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 9 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019066.611731:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0900, rc 0) 00000100:00100000:2.0:1717019066.611789:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838689472:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 130us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019066.611795:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1499 00000100:00100000:0.0:1717019066.613447:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019066.613551:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689536 00000100:00100000:2.0:1717019066.613655:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1500 00000100:00100000:2.0:1717019066.613661:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838689536:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019066.613802:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838689536:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 141us (361us total) trans 0 rc -2/-2 00000100:00100000:2.0:1717019066.613808:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1500 00010000:00010000:1.0:1717019066.809314:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717019067.050949:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717019067.050956:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 138 10000000:01000000:2.0:1717019067.050961:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717019067.051004:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.051014:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.051040:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.051062:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819944960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.051128:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.051174:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.051211:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819944960 00000100:00100000:0.0:1717019067.051263:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1501 00000100:00100000:0.0:1717019067.051268:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819944960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019067.051280:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019067.051297:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c2130 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.051316:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c2130 expref: 12 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.051325:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2130 expref: 12 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.051332:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e21c0, rc 0) 00000100:00100000:0.0:1717019067.051371:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819944960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.051377:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1501 00000100:00100000:2.0:1717019067.051391:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819944960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019067.051402:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.051408:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.051455:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.051474:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.051493:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.051510:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945024 00000100:00100000:0.0:1717019067.051521:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1502 00000100:00100000:0.0:1717019067.051524:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819945024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.051634:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819945024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.051640:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1502 00000100:00100000:2.0:1717019067.051652:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.051677:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.051705:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.051711:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.051719:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945088 00000100:00100000:0.0:1717019067.051729:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1503 00000100:00100000:0.0:1717019067.051732:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819945088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.051940:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819945088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 207us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.051952:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1503 00000100:00100000:2.0:1717019067.051958:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.052172:0:2232:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2232:1800422819945152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.052197:0:2232:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.052211:0:2232:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008ab07840 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.052250:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945152 00000100:00100000:0.0:1717019067.052262:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1504 00000100:00100000:0.0:1717019067.052264:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:2232:x1800422819945152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019067.052552:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:2232:x1800422819945152:12345-0@lo:502:llog_process_th.0 Request processed in 287us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.052558:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1504 00000100:00100000:3.0:1717019067.052672:0:2232:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2232:1800422819945152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.052700:0:2232:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2232:1800422819945216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.052721:0:2232:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.055311:0:2232:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008ab07840 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.055378:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945216 00000100:00100000:0.0:1717019067.055430:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1505 00000100:00100000:0.0:1717019067.055434:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:2232:x1800422819945216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019067.055667:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:2232:x1800422819945216:12345-0@lo:502:llog_process_th.0 Request processed in 232us (2945us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.055673:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1505 00000100:00100000:3.0:1717019067.055754:0:2232:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2232:1800422819945216:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717019067.055787:0:2232:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 141 count 138 00000020:01000000:2.0:1717019067.055847:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 138-140 (rc=0) 10000000:01000000:2.0:1717019067.055873:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019067.055884:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.055907:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019067.055915:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1717019067.055917:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 132 10000000:01000000:2.0:1717019067.055919:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1717019067.055942:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.055951:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.055958:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.055975:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.056004:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.056014:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.056039:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945280 00000100:00100000:0.0:1717019067.056052:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1506 00000100:00100000:0.0:1717019067.056055:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819945280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019067.056060:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019067.056071:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c213e expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.056088:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c213e expref: 13 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.056095:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c213e expref: 13 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.056101:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e2d00, rc 0) 00000100:00100000:0.0:1717019067.056131:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819945280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 76us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.056136:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1506 00000100:00100000:2.0:1717019067.059036:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019067.059062:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.059072:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.059143:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.059200:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.059234:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.059268:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945344 00000100:00100000:0.0:1717019067.059300:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1507 00000100:00100000:0.0:1717019067.059304:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819945344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.059425:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819945344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 120us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.059431:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1507 00000100:00100000:2.0:1717019067.059441:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.059472:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.059501:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.059507:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.059514:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945408 00000100:00100000:0.0:1717019067.059524:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1508 00000100:00100000:0.0:1717019067.059527:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819945408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.059686:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819945408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.059691:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1508 00000100:00100000:2.0:1717019067.059702:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.060050:0:2233:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2233:1800422819945472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.060078:0:2233:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.060103:0:2233:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008ab07840 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.060189:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945472 00000100:00100000:0.0:1717019067.060201:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1509 00000100:00100000:0.0:1717019067.060203:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2233:x1800422819945472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019067.061201:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2233:x1800422819945472:12345-0@lo:502:llog_process_th.0 Request processed in 994us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.061209:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1509 00000100:00100000:3.0:1717019067.061299:0:2233:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2233:1800422819945472:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717019067.061322:0:2233:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717019067.061330:0:2233:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717019067.061332:0:2233:0:(obd_config.c:1460:class_process_config()) marker 89 (0x1) lustre-MDT0000-m rem lustre.test_23e.lustre-OST0000_UUID 00000020:00000080:3.0:1717019067.061343:0:2233:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1717019067.061357:0:2233:0:(lod_pool.c:669:lod_pool_remove()) lustre-OST0000_UUID removed from test_23e 00000100:00100000:0.0:1717019067.062559:0:2233:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3d0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2233:1800422819945536:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019067.062598:0:2233:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019067.062620:0:2233:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099c9cb40 going to sleep for 6 seconds 00000100:00100000:1.0:1717019067.062643:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945536 00000100:00100000:1.0:1717019067.062680:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1510 00000100:00100000:1.0:1717019067.062684:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2233:x1800422819945536:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019067.062911:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2233:x1800422819945536:12345-0@lo:502:llog_process_th.0 Request processed in 225us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019067.062917:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1510 00000020:01000004:3.0:1717019067.063041:0:2234:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff880090828000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1717019067.063044:0:2234:0:(obd_mount.c:668:lustre_put_lsi()) put ffff880090828000 4 00000100:00100000:0.0:1717019067.063270:0:2233:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3d0c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2233:1800422819945536:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1717019067.063295:0:2233:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1717019067.063299:0:2233:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1717019067.063300:0:2233:0:(obd_config.c:1460:class_process_config()) marker 89 (0x2) lustre-MDT0000-m rem lustre.test_23e.lustre-OST0000_UUID 00000040:00080000:0.0:1717019067.063304:0:2233:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 136 count 133 00000020:01000000:2.0:1717019067.063361:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 132-135 (rc=0) 10000000:01000000:2.0:1717019067.063396:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1717019067.063403:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.063413:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019067.063426:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717019067.063429:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 138 10000000:01000000:2.0:1717019067.063431:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717019067.063450:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.063457:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.063463:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.063473:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.063499:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.063523:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:3.0:1717019067.063541:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945600 00000100:00100000:3.0:1717019067.063565:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1511 00000100:00100000:3.0:1717019067.063569:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819945600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717019067.064296:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717019067.064314:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c214c expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.064336:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c214c expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.064341:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c214c expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.064345:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880093e9c6c0, rc 0) 00000100:00100000:3.0:1717019067.064408:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819945600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 839us (908us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.064414:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1511 00000100:00100000:2.0:1717019067.064440:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019067.064462:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.064470:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.064511:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.064536:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.064555:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:3.0:1717019067.064582:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945664 00000100:00100000:3.0:1717019067.064614:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1512 00000100:00100000:3.0:1717019067.064618:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819945664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.064718:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819945664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 100us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.064724:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1512 00000100:00100000:2.0:1717019067.064749:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.064770:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.064803:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.064861:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880093ef60c0 going to sleep for 6 seconds 00000100:00100000:3.0:1717019067.064868:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945728 00000100:00100000:3.0:1717019067.064895:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1513 00000100:00100000:3.0:1717019067.064905:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819945728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.065508:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819945728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 602us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.065514:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1513 00000100:00100000:2.0:1717019067.065577:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.065906:0:2235:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2235:1800422819945792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.065934:0:2235:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.065957:0:2235:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de32780 going to sleep for 6 seconds 00000100:00100000:2.0:1717019067.065997:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945792 00000100:00100000:2.0:1717019067.066021:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1514 00000100:00100000:2.0:1717019067.066025:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:2235:x1800422819945792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717019067.066559:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:2235:x1800422819945792:12345-0@lo:502:llog_process_th.0 Request processed in 533us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.066565:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1514 00000100:00100000:3.0:1717019067.066628:0:2235:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2235:1800422819945792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.066658:0:2235:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2235:1800422819945856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.066681:0:2235:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.066689:0:2235:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de32780 going to sleep for 6 seconds 00000100:00100000:2.0:1717019067.066734:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945856 00000100:00100000:2.0:1717019067.066757:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1515 00000100:00100000:2.0:1717019067.066760:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:2235:x1800422819945856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1717019067.066883:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebef850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:2235:x1800422819945856:12345-0@lo:502:llog_process_th.0 Request processed in 122us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.066897:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1515 00000100:00100000:3.0:1717019067.066952:0:2235:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2235:1800422819945856:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717019067.066968:0:2235:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 141 count 138 00000020:01000000:2.0:1717019067.067132:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 138-140 (rc=0) 10000000:01000000:2.0:1717019067.067156:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019067.067170:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.067180:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019067.067188:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1717019067.067190:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1717019067.067193:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1717019067.067209:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.067215:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.067223:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.067233:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.067255:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.067308:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9d80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.067468:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945920 00000100:00100000:0.0:1717019067.067484:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1516 00000100:00100000:0.0:1717019067.067487:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819945920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019067.067493:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019067.067504:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c215a expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.067520:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c215a expref: 15 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.067526:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c215a expref: 15 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.067533:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1b00, rc 0) 00000100:00100000:0.0:1717019067.067568:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819945920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.067574:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1516 00000100:00100000:3.0:1717019067.067646:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717019067.067656:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.067662:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019067.067692:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.067711:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.067720:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de32780 going to sleep for 6 seconds 00000100:00100000:2.0:1717019067.067791:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819945984 00000100:00100000:2.0:1717019067.067814:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1517 00000100:00100000:2.0:1717019067.067817:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819945984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.067908:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819945984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.067921:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1517 00000100:00100000:3.0:1717019067.068038:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819945984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.068064:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.068088:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.068097:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de32780 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.068147:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946048 00000100:00100000:0.0:1717019067.068171:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1518 00000100:00100000:0.0:1717019067.068174:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819946048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.068314:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819946048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.068318:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1518 00000100:00100000:3.0:1717019067.068596:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717019067.069328:0:2236:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:0.0:1717019067.069427:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1717019067.069448:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1717019067.069453:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.069461:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019067.069468:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717019067.069470:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 138 10000000:01000000:0.0:1717019067.069472:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717019067.069488:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.069493:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.069499:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019067.069510:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3d0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.069534:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019067.069555:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880099c9c300 going to sleep for 6 seconds 00000100:00100000:2.0:1717019067.069610:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946112 00000100:00100000:2.0:1717019067.069629:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1519 00000100:00100000:2.0:1717019067.069632:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819946112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019067.069638:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019067.069647:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c2168 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.069661:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c2168 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.069667:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2168 expref: 16 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.069673:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d21c0, rc 0) 00000100:00100000:2.0:1717019067.069788:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebed050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819946112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.069793:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1519 00000100:00100000:1.0:1717019067.069871:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3d0c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019067.069887:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.069893:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019067.069932:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.069952:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.069961:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:2.0:1717019067.070022:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946176 00000100:00100000:2.0:1717019067.070104:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1520 00000100:00100000:2.0:1717019067.070107:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819946176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.070203:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebeb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819946176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.070209:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1520 00000100:00100000:1.0:1717019067.070358:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.070380:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.070408:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.070579:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.070619:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946240 00000100:00100000:0.0:1717019067.070674:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1521 00000100:00100000:0.0:1717019067.070677:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819946240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.071128:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ebe8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819946240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 449us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.071133:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1521 00000100:00100000:1.0:1717019067.071311:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019067.072221:0:2237:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2237:1800422819946304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.072265:0:2237:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.072325:0:2237:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de32780 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.072361:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946304 00000100:00100000:0.0:1717019067.072382:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1522 00000100:00100000:0.0:1717019067.072391:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2237:x1800422819946304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019067.072768:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2237:x1800422819946304:12345-0@lo:502:llog_process_th.0 Request processed in 377us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.072774:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1522 00000100:00100000:3.0:1717019067.072809:0:2237:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2237:1800422819946304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.072887:0:2237:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2237:1800422819946368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019067.072929:0:2237:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.072945:0:2237:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008de32780 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.072948:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946368 00000100:00100000:0.0:1717019067.072968:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1523 00000100:00100000:0.0:1717019067.072971:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2237:x1800422819946368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019067.073089:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2237:x1800422819946368:12345-0@lo:502:llog_process_th.0 Request processed in 117us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.073095:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1523 00000100:00100000:3.0:1717019067.073402:0:2237:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2237:1800422819946368:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717019067.073429:0:2237:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 141 count 138 00000020:01000000:1.0:1717019067.073576:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 138-140 (rc=0) 10000000:01000000:1.0:1717019067.073603:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1717019067.073609:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.073620:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717019067.073628:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1717019067.073630:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:1.0:1717019067.073632:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1717019067.073652:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.073667:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.073674:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019067.073685:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.073709:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.074142:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.074202:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946432 00000100:00100000:0.0:1717019067.074231:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1524 00000100:00100000:0.0:1717019067.074234:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819946432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019067.074241:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019067.074253:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c2176 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.074270:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c2176 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.074277:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2176 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.074284:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e0900, rc 0) 00000100:00100000:0.0:1717019067.074485:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819946432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 250us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.074490:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1524 00000100:00100000:1.0:1717019067.074564:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019067.074574:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.074581:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019067.074617:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.074636:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.074644:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.074700:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946496 00000100:00100000:0.0:1717019067.074723:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1525 00000100:00100000:0.0:1717019067.074726:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819946496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.074805:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819946496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.074809:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1525 00000100:00100000:1.0:1717019067.075151:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.075182:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.075211:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.075228:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:2.0:1717019067.075342:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946560 00000100:00100000:2.0:1717019067.075360:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1526 00000100:00100000:2.0:1717019067.075363:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819946560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019067.075531:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819946560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 167us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.075536:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1526 00000100:00100000:1.0:1717019067.075723:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717019067.076722:0:2238:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:1.0:1717019067.076867:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:1.0:1717019067.076894:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1717019067.076899:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.076908:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717019067.076915:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1717019067.076918:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:1.0:1717019067.076920:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1717019067.076934:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.076939:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.076946:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019067.076958:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.076985:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.077006:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.077051:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946624 00000100:00100000:0.0:1717019067.077078:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1527 00000100:00100000:0.0:1717019067.077081:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819946624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019067.077087:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019067.077097:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c2184 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.077113:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c2184 expref: 18 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.077119:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2184 expref: 18 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.077124:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1680, rc 0) 00000100:00100000:0.0:1717019067.077143:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819946624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.077147:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1527 00000100:00100000:1.0:1717019067.077251:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019067.077259:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.077268:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019067.077294:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019067.077315:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.077335:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bcf0480 going to sleep for 6 seconds 00000100:00100000:0.0:1717019067.077378:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946688 00000100:00100000:0.0:1717019067.077430:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1528 00000100:00100000:0.0:1717019067.077433:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819946688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019067.077487:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819946688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1717019067.077499:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1528 00000100:00100000:1.0:1717019067.077576:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d04c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819946688:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1717019067.077590:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1717019067.077592:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.077598:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.812009:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1717019067.841523:0:2370:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1717019067.841531:0:2370:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1717019067.841534:0:2370:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1717019067.841802:0:2370:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1717019067.841807:0:2370:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1717019067.841996:0:2370:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_23e fl=4 20000000:01000000:1.0:1717019067.842592:0:2371:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 126 marker 85 1->4: lustre-MDT0000-mdtlov new lustre.test_23e 20000000:01000000:1.0:1717019067.842654:0:2371:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 128 marker 85 2->4: lustre-MDT0000-mdtlov new lustre.test_23e 00000040:00080000:1.0:1717019067.842700:0:2371:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 136 count 133 00000040:00080000:0.0:1717019067.843013:0:2370:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].136, 224 off33584 20000000:01000000:0.0:1717019067.843021:0:2370:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_23e (null) (null) 00000040:00080000:0.0:1717019067.843049:0:2370:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].137, 120 off33704 00000040:00080000:0.0:1717019067.843111:0:2370:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].138, 224 off33928 20000000:01000000:0.0:1717019067.843402:0:2370:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_23e fl=4 20000000:01000000:0.0:1717019067.843915:0:2372:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 131 marker 86 1->4: lustre-clilov new lustre.test_23e 20000000:01000000:0.0:1717019067.843967:0:2372:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 134 marker 86 2->4: lustre-clilov new lustre.test_23e 00000040:00080000:0.0:1717019067.843998:0:2372:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 141 count 138 00000040:00080000:2.0:1717019067.844209:0:2370:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].141, 224 off34384 20000000:01000000:2.0:1717019067.844218:0:2370:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce023 lustre test_23e (null) (null) 00000040:00080000:2.0:1717019067.844250:0:2370:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].142, 112 off34496 00000040:00080000:2.0:1717019067.844284:0:2370:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].143, 224 off34720 10000000:01000000:2.0:1717019067.844296:0:2370:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1717019067.844307:0:2370:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844322:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844327:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844332:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2130 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844337:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c213e expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844341:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c214c expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844345:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c215a expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844349:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2168 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844359:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2176 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844363:0:2370:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2184 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844367:0:2370:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844395:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2184 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844405:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2184 expref: 17 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844413:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946752:0@lo:104: 00000100:00100000:2.0:1717019067.844454:0:2370:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717019067.844487:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2176 expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844493:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2176 expref: 17 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844498:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946816:0@lo:104: 00000100:00100000:2.0:1717019067.844514:0:2370:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717019067.844541:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2168 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844546:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2168 expref: 17 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844559:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132b06880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946880:0@lo:104: 00000100:00100000:2.0:1717019067.844576:0:2370:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717019067.844602:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c215a expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844607:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c215a expref: 17 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844612:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880132b050c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946944:0@lo:104: 00010000:00010000:2.0:1717019067.844632:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c214c expref: 17 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844636:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c214c expref: 17 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844641:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539df00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947008:0@lo:104: 00000100:00100000:1.0:1717019067.844653:0:26222:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1717019067.844655:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c213e expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844660:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c213e expref: 17 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844665:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539ed40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947072:0@lo:104: 00000100:00100000:1.0:1717019067.844665:0:26222:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.844675:0:26222:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.844681:0:2370:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.844683:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946752 00010000:00010000:2.0:1717019067.844691:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x81e56358f42c2130 expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844697:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x81e56358f42c2130 expref: 17 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:1.0:1717019067.844700:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946816 00000100:00100000:1.0:1717019067.844704:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946880 00000100:00100000:1.0:1717019067.844707:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819946944 00000100:00100000:2.0:1717019067.844710:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013539d0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947136:0@lo:104: 00000100:00100000:1.0:1717019067.844710:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947008 00000100:00100000:1.0:1717019067.844714:0:26222:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947072 00000100:00100000:1.0:1717019067.844720:0:26222:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1717019067.844725:0:2370:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.844725:0:26222:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+8:2370:x1800422819946752:12345-0@lo:104: 00010000:00010000:2.0:1717019067.844736:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.844742:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.844749:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801353984c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947200:192.168.203.26@tcp:104: 00000100:00100000:0.0:1717019067.844802:0:6895:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947136 00000100:00100000:0.0:1717019067.844820:0:6895:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1717019067.844823:0:6895:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+9:2370:x1800422819946816:12345-0@lo:104: 00000100:00100000:3.0:1717019067.844885:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1717019067.844889:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009e8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+9:2370:x1800422819946880:12345-0@lo:104: 00010000:00010000:3.0:1717019067.845394:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1717019067.845398:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009e8ad850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+9:2370:x1800422819946880:12345-0@lo:104: Request processed in 509us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.845404:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1717019067.845416:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1717019067.845419:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+8:2370:x1800422819946944:12345-0@lo:104: 00010000:00010000:3.0:1717019067.845449:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1717019067.845453:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d04c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+8:2370:x1800422819946944:12345-0@lo:104: Request processed in 33us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.845456:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1717019067.845464:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1717019067.845466:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d6880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+7:2370:x1800422819947008:12345-0@lo:104: 00010000:00010000:3.0:1717019067.845483:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1717019067.845485:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d6880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+7:2370:x1800422819947008:12345-0@lo:104: Request processed in 19us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.845489:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1717019067.845497:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1717019067.845499:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+6:2370:x1800422819947072:12345-0@lo:104: 00010000:00010000:3.0:1717019067.845517:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1717019067.845519:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+6:2370:x1800422819947072:12345-0@lo:104: Request processed in 20us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.845523:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1717019067.845530:0:6615:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1717019067.845532:0:6615:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+5:2370:x1800422819947136:12345-0@lo:104: 00010000:00010000:3.0:1717019067.845549:0:6615:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1717019067.845551:0:6615:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:627fc11f-491c-4f89-ad31-986408f4a526+5:2370:x1800422819947136:12345-0@lo:104: Request processed in 19us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.845554:0:6615:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00010000:00010000:3.0:1717019067.845566:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1717019067.845570:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845583:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e0000 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717019067.845585:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845590:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019067.845595:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019067.845598:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019067.845619:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845624:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019067.845634:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845638:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8801334e0000/0x81e56358f42c2168 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c216f expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845646:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1717019067.845647:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845651:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0d80 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717019067.845652:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845656:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019067.845667:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019067.845670:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019067.845679:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845683:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019067.845691:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845694:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c215a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2161 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845700:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1717019067.845702:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845706:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1680 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717019067.845707:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845711:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019067.845714:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019067.845718:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019067.845725:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845736:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019067.845740:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845743:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c214c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2153 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845748:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1717019067.845750:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845753:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d3180 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717019067.845754:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845758:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019067.845761:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019067.845764:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019067.845773:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845777:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019067.845779:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845783:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d3180/0x81e56358f42c213e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2145 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845800:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1717019067.845801:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845805:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d3840 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:3.0:1717019067.845806:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845810:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1717019067.845814:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1717019067.845817:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1717019067.845842:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845847:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1717019067.845850:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845853:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c2130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c2137 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019067.845859:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019067.845860:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019067.845861:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019067.845875:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819947328:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1717019067.845896:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.845917:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1717019067.845921:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2351c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819947392:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1717019067.845933:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.845950:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947328 00010000:00010000:3.0:1717019067.845960:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c215a expref: 18 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:3.0:1717019067.845972:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947392 00010000:00010000:3.0:1717019067.845977:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c214c expref: 19 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:3.0:1717019067.845988:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75478 00000100:00100000:3.0:1717019067.845990:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2351300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819947328:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717019067.845997:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717019067.845999:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c215a expref: 19 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:3.0:1717019067.846004:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c215a expref: 19 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:3.0:1717019067.846014:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717019067.846032:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2351300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+19:2852:x1800422819947328:12345-0@lo:103:ldlm_bl_03.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.846037:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75478 00000100:00100000:3.0:1717019067.846046:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75479 00000100:00100000:3.0:1717019067.846048:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a23576c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819947392:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1717019067.846053:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1717019067.846056:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c214c expref: 18 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:3.0:1717019067.846068:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c214c expref: 18 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:3.0:1717019067.846075:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717019067.846090:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a23576c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+18:2852:x1800422819947392:12345-0@lo:103:ldlm_bl_03.0 Request processed in 41us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.846095:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75479 00000100:00100000:3.0:1717019067.846123:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2351c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819947392:0@lo:103:ldlm_bl_03.0 00000100:00100000:3.0:1717019067.846129:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:627fc11f-491c-4f89-ad31-986408f4a526:2852:1800422819947328:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019067.846202:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819947264:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019067.846223:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.846232:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2354c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819947520:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019067.846243:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.846250:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1717019067.846253:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819947456:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019067.846262:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1717019067.846372:0:2370:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 8 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846377:0:26222:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1717019067.846381:0:26222:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:627fc11f-491c-4f89-ad31-986408f4a526+4:2370:x1800422819946752:12345-0@lo:104: Request processed in 1657us (1927us total) trans 0 rc 0/0 00010000:00010000:2.0:1717019067.846382:0:2370:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 8 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:1.0:1717019067.846386:0:26222:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1717019067.846388:0:2370:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121f6c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947584:192.168.203.26@tcp:104: 00010000:00010000:2.0:1717019067.846393:0:14979:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1717019067.846396:0:14979:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846398:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019067.846407:0:14979:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79ed00 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:2.0:1717019067.846409:0:14979:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846412:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019067.846413:0:14979:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846414:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1717019067.846417:0:14979:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846419:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1717019067.846420:0:14979:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1717019067.846433:0:14979:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.846441:0:14979:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1717019067.846447:0:14979:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.846451:0:14979:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c218b expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.846457:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019067.846457:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1717019067.846458:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019067.846461:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1717019067.846467:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800812184c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819947648:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1717019067.846489:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019067.846506:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947264 00010000:00010000:2.0:1717019067.846515:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2168 expref: 18 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.846529:0:6895:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1717019067.846533:0:6895:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:627fc11f-491c-4f89-ad31-986408f4a526+3:2370:x1800422819946816:12345-0@lo:104: Request processed in 1709us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.846535:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947520 00000100:00100000:0.0:1717019067.846537:0:6895:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00010000:00010000:2.0:1717019067.846541:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2130 expref: 19 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.846549:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947456 00010000:00010000:2.0:1717019067.846553:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c213e expref: 20 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.846561:0:14966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947648 00010000:00010000:2.0:1717019067.846565:0:14966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2184 expref: 21 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:0.0:1717019067.846569:0:6617:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75480 00000100:00100000:0.0:1717019067.846572:0:6617:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880135399c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+21:2855:x1800422819947264:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019067.846576:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75481 00010000:00010000:0.0:1717019067.846577:0:6617:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1717019067.846578:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+21:2855:x1800422819947520:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1717019067.846579:0:6617:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2168 expref: 21 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:2.0:1717019067.846582:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019067.846583:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2130 expref: 21 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.846584:0:6617:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2168 expref: 21 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:2.0:1717019067.846589:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2130 expref: 21 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:1.0:1717019067.846614:0:8092:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1717019067.846617:0:8092:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846620:0:8092:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c79dd40 already unused, calling callback (ffffffffa02815c0) 10000000:00010000:1.0:1717019067.846621:0:8092:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846625:0:8092:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1717019067.846628:0:8092:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1717019067.846632:0:8092:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1717019067.846646:0:8092:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846649:0:8092:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1717019067.846654:0:8092:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846657:0:8092:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.126@tcp lock: ffff88008c79dd40/0x81e56358f42c2176 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0x81e56358f42c217d expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019067.846670:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019067.846671:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019067.846672:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019067.846681:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819947712:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1717019067.846697:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019067.846717:0:6618:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947712 00010000:00010000:1.0:1717019067.846724:0:6618:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2176 expref: 22 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:1.0:1717019067.846734:0:6618:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75482 00000100:00100000:1.0:1717019067.846737:0:6618:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+22:2855:x1800422819947456:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:1.0:1717019067.846741:0:6618:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1717019067.846743:0:6618:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c213e expref: 22 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.846773:0:6617:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717019067.846779:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717019067.846792:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539da40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+22:2855:x1800422819947520:12345-0@lo:103:ldlm_bl_03.0 Request processed in 213us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.846792:0:6617:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880135399c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+22:2855:x1800422819947264:12345-0@lo:103:ldlm_bl_03.0 Request processed in 219us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.846796:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75481 00000100:00100000:0.0:1717019067.846802:0:6617:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75480 00000100:00100000:2.0:1717019067.846805:0:14966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75483 00000100:00100000:2.0:1717019067.846808:0:14966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+20:2853:x1800422819947648:12345-0@lo:103:ldlm_bl_04.0 00000100:00100000:0.0:1717019067.846810:0:6617:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75484 00000100:00100000:0.0:1717019067.846812:0:6617:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d50c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+20:2853:x1800422819947712:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1717019067.846813:0:14966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019067.846815:0:14966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2184 expref: 20 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.846816:0:6617:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717019067.846818:0:6617:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x81e56358f42c2176 expref: 20 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.846822:0:6617:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2176 expref: 20 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.846842:0:6617:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1717019067.846859:0:6617:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d50c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:627fc11f-491c-4f89-ad31-986408f4a526+20:2853:x1800422819947712:12345-0@lo:103:ldlm_bl_03.0 Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.846863:0:6617:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75484 00000100:00100000:0.0:1717019067.846879:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2353440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819947264:0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1717019067.846884:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2354c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819947520:0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1717019067.846956:0:14966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c2184 expref: 19 pid: 8249 timeout: 2200 lvb_type: 0 00010000:00010000:2.0:1717019067.846964:0:14966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717019067.846979:0:14966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6e4f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:627fc11f-491c-4f89-ad31-986408f4a526+19:2853:x1800422819947648:12345-0@lo:103:ldlm_bl_04.0 Request processed in 171us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.846984:0:14966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75483 00010000:00010000:1.0:1717019067.847016:0:6618:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x81e56358f42c213e expref: 18 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.847017:0:2370:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03a80 going to sleep for 6 seconds 00010000:00010000:1.0:1717019067.847023:0:6618:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1717019067.847024:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1680/0x81e56358f42c218b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2184 expref: 18 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.847031:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946752:0@lo:104: 00010000:00010000:2.0:1717019067.847037:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e0900/0x81e56358f42c217d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2176 expref: 17 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:1.0:1717019067.847037:0:6618:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539c740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:627fc11f-491c-4f89-ad31-986408f4a526+17:2855:x1800422819947456:12345-0@lo:103:ldlm_bl_03.0 Request processed in 301us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.847042:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137149300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946816:0@lo:104: 00000100:00100000:1.0:1717019067.847042:0:6618:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75482 00010000:00010000:2.0:1717019067.847047:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d21c0/0x81e56358f42c216f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2168 expref: 15 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.847052:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132b06880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946880:0@lo:104: 00010000:00010000:2.0:1717019067.847057:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e1b00/0x81e56358f42c2161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c215a expref: 14 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.847062:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880132b050c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819946944:0@lo:104: 00010000:00010000:2.0:1717019067.847067:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880093e9c6c0/0x81e56358f42c2153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c214c expref: 13 pid: 8249 timeout: 2200 lvb_type: 0 00000100:00100000:1.0:1717019067.847067:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819947712:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1717019067.847071:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800812184c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819947648:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1717019067.847072:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539df00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947008:0@lo:104: 00010000:00010000:2.0:1717019067.847076:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e2d00/0x81e56358f42c2145 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c213e expref: 12 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.847087:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539ed40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947072:0@lo:104: 00010000:00010000:2.0:1717019067.847093:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8801334e21c0/0x81e56358f42c2137 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x81e56358f42c2130 expref: 11 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.847097:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013539d0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947136:0@lo:104: 00000100:00100000:0.0:1717019067.847204:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819947456:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1717019067.849100:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801353984c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947200:192.168.203.26@tcp:104: 00000100:00100000:2.0:1717019067.849108:0:2370:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121f6c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:2370:1800422819947584:192.168.203.26@tcp:104: 00010000:00010000:2.0:1717019067.849147:0:2370:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.850213:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019067.850247:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019067.850337:0:6616:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689600 00000100:00100000:2.0:1717019067.850343:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689664 00010000:00010000:0.0:1717019067.850362:0:6616:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 10 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:0.0:1717019067.850386:0:6616:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75485 00000100:00100000:0.0:1717019067.850390:0:6616:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+10:1835:x1800422838689600:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 00010000:00010000:0.0:1717019067.850401:0:6616:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1717019067.850404:0:6616:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 10 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.850418:0:6616:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 10 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.850429:0:6616:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d0240/0x81e56358f42c2122 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a368ff expref: 10 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:0.0:1717019067.850439:0:6616:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1717019067.850481:0:6616:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121f6c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838689600:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 Request processed in 90us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019067.850487:0:6616:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75485 00010000:00010000:2.0:1717019067.850701:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 2200 lvb_type: 0 00000100:00100000:2.0:1717019067.850717:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75486 00000100:00100000:2.0:1717019067.850721:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:461e9689-0dac-4669-87c3-00abdddc539f+8:1835:x1800422838689664:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 00010000:00010000:2.0:1717019067.850726:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019067.850728:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:2.0:1717019067.850734:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:2.0:1717019067.850742:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d0900/0x81e56358f42c2129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36906 expref: 8 pid: 8250 timeout: 2200 lvb_type: 0 00010000:00010000:2.0:1717019067.850759:0:8093:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850764:0:8093:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850774:0:8093:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850779:0:8093:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850782:0:8093:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850786:0:8093:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850790:0:8093:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d33c0 already unused, calling callback (ffffffffa0811190) 00010000:00010000:2.0:1717019067.850793:0:8093:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850797:0:8093:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850814:0:8093:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019067.850822:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717019067.850867:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121af80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:461e9689-0dac-4669-87c3-00abdddc539f+7:1835:x1800422838689664:12345-192.168.203.26@tcp:103:ldlm_bl_03.0 Request processed in 145us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019067.850872:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75486 00010000:00010000:0.0:1717019067.850921:0:2370:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.850928:0:2370:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019067.850932:0:2370:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a69d33c0/0x81e56358f42c2192 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 2370 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019067.852607:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1717019067.852621:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819947776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1717019067.852661:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019067.852714:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947776 00000100:00100000:3.0:1717019067.852751:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 635 00000100:00100000:3.0:1717019067.852755:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880081219c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819947776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1717019067.852785:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1717019067.852842:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880081219c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819947776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019067.852847:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 635 00000100:00100000:2.0:1717019067.852954:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3f6c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819947776:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019068.270646:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019068.270686:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019068.270721:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019068.270743:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019068.270765:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689920 00000100:00100000:0.0:1717019068.270805:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689856 00000100:00100000:0.0:1717019068.270818:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1138 00000100:00100000:0.0:1717019068.270822:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838689920:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717019068.270895:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838689920:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 73us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.270909:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1138 00000100:00100000:0.0:1717019068.270921:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1139 00000100:00100000:0.0:1717019068.270924:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838689856:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717019068.270942:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838689856:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 17us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.270946:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1139 00000100:00100000:0.0:1717019068.270959:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689728 00000100:00100000:0.0:1717019068.270973:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1529 00000100:00100000:0.0:1717019068.270976:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+7:1836:x1800422838689728:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1717019068.270989:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db93850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+7:1836:x1800422838689728:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 13us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.270993:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1529 00000100:00100000:2.0:1717019068.272282:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689792 00000100:00100000:2.0:1717019068.272315:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 849 00000100:00100000:2.0:1717019068.272319:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+66:1836:x1800422838689792:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00010000:00000080:2.0:1717019068.272334:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880130f3f6c0 x1800422838689792/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:413/0 lens 224/224 e 0 to 0 dl 1717019148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717019068.272364:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3f6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+66:1836:x1800422838689792:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 45us (1724us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.272369:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 849 00010000:00010000:1.0:1717019068.814037:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1717019068.817970:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1717019068.817976:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880090828000 from 141 10000000:01000000:1.0:1717019068.817990:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1717019068.818020:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019068.818027:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019068.818035:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019068.818053:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819947840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.818104:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.818647:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.818717:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947840 00000100:00100000:0.0:1717019068.818768:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1530 00000100:00100000:0.0:1717019068.818773:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+11:6629:x1800422819947840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019068.818781:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019068.818793:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e33c0/0x81e56358f42c21a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c2199 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.818811:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e33c0/0x81e56358f42c21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c2199 expref: 12 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.818817:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e33c0/0x81e56358f42c21a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c2199 expref: 12 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.818824:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e33c0, rc 0) 00000100:00100000:0.0:1717019068.818889:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db94050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819947840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.818894:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1530 00000100:00100000:1.0:1717019068.819028:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819947840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019068.819038:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21a0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019068.819045:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21a0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019068.819088:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819947904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.819109:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.819602:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.819719:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947904 00000100:00100000:2.0:1717019068.819736:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1531 00000100:00100000:2.0:1717019068.819739:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819947904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.819853:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819947904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.819857:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1531 00000100:00100000:1.0:1717019068.819933:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819947904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.819952:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819947968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.819980:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.820606:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.820668:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819947968 00000100:00100000:0.0:1717019068.820881:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1532 00000100:00100000:0.0:1717019068.820886:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819947968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.821326:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819947968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 439us (1344us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.821332:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1532 00000100:00100000:1.0:1717019068.821593:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819947968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.821917:0:2390:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2390:1800422819948032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019068.821945:0:2390:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.822240:0:2390:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.822287:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948032 00000100:00100000:0.0:1717019068.822314:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1533 00000100:00100000:0.0:1717019068.822318:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:2390:x1800422819948032:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.823119:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db96050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:2390:x1800422819948032:12345-0@lo:502:llog_process_th.0 Request processed in 799us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.823126:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1533 00000100:00100000:1.0:1717019068.823203:0:2390:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2390:1800422819948032:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019068.823242:0:2390:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2390:1800422819948096:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019068.823266:0:2390:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.823274:0:2390:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.823314:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948096 00000100:00100000:0.0:1717019068.823339:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1534 00000100:00100000:0.0:1717019068.823342:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:2390:x1800422819948096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.823472:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db95850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+12:2390:x1800422819948096:12345-0@lo:502:llog_process_th.0 Request processed in 128us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.823477:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1534 00000100:00100000:1.0:1717019068.823562:0:2390:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2390:1800422819948096:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1717019068.823576:0:2390:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 144 count 141 00000020:01000000:2.0:1717019068.823772:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 141-143 (rc=0) 10000000:01000000:2.0:1717019068.823797:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019068.823802:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21a0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.823811:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff88008c79ed00/0x81e56358f42c2199 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21a0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019068.823839:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1717019068.823841:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 136 10000000:01000000:2.0:1717019068.823843:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1717019068.823859:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.823864:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.823870:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.823972:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.823994:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.824010:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.824044:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948160 00000100:00100000:0.0:1717019068.824058:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1535 00000100:00100000:0.0:1717019068.824060:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008db96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+12:6629:x1800422819948160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019068.824065:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019068.824079:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e21c0/0x81e56358f42c21ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c21a7 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.824093:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e21c0/0x81e56358f42c21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c21a7 expref: 13 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.824099:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e21c0/0x81e56358f42c21ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c21a7 expref: 13 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.824104:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e21c0, rc 0) 00000100:00100000:0.0:1717019068.824132:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008db96850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819948160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.824135:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1535 00000100:00100000:3.0:1717019068.824226:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121d580 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717019068.824236:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21ae expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.824242:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21ae expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019068.824280:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.824302:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.824378:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.824418:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948224 00000100:00100000:2.0:1717019068.824444:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1536 00000100:00100000:2.0:1717019068.824448:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d912850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819948224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.824527:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d912850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819948224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.824532:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1536 00000100:00100000:3.0:1717019068.824580:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.824598:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.824624:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.824633:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced6c0 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.824678:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948288 00000100:00100000:2.0:1717019068.824701:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1537 00000100:00100000:2.0:1717019068.824704:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819948288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.824857:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d917850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819948288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.824862:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1537 00000100:00100000:3.0:1717019068.825161:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.826354:0:2391:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2391:1800422819948352:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019068.826392:0:2391:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.826417:0:2391:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.826437:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948352 00000100:00100000:0.0:1717019068.826471:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1538 00000100:00100000:0.0:1717019068.826475:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2391:x1800422819948352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.826812:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d914050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2391:x1800422819948352:12345-0@lo:502:llog_process_th.0 Request processed in 336us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.826819:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1538 00000100:00100000:3.0:1717019068.826952:0:2391:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2391:1800422819948352:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717019068.826973:0:2391:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1717019068.826979:0:2391:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717019068.826981:0:2391:0:(obd_config.c:1460:class_process_config()) marker 91 (0x1) lustre-MDT0000-m del lustre.test_23e 00000020:00000080:3.0:1717019068.826984:0:2391:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:3.0:1717019068.828290:0:2391:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2391:1800422819948416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019068.828334:0:2391:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.828364:0:2391:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced6c0 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.828430:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948416 00000100:00100000:0.0:1717019068.828490:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1539 00000100:00100000:0.0:1717019068.828494:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2391:x1800422819948416:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.828652:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+13:2391:x1800422819948416:12345-0@lo:502:llog_process_th.0 Request processed in 157us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.828658:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1539 00000100:00100000:3.0:1717019068.828735:0:2391:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2391:1800422819948416:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1717019068.828759:0:2391:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1717019068.828761:0:2391:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1717019068.828763:0:2391:0:(obd_config.c:1460:class_process_config()) marker 91 (0x2) lustre-MDT0000-m del lustre.test_23e 00000040:00080000:3.0:1717019068.828765:0:2391:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 139 count 136 00000020:01000000:0.0:1717019068.828843:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 136-138 (rc=0) 10000000:01000000:0.0:1717019068.828864:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1717019068.828868:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21ae expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.828880:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d3840/0x81e56358f42c21a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21ae expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019068.828887:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1717019068.828890:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009757f800 from 141 10000000:01000000:0.0:1717019068.828891:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1717019068.828906:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.828911:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.828917:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019068.828925:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.828943:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019068.828962:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1f62e40 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.829000:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948480 00000100:00100000:2.0:1717019068.829021:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1717019068.829025:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+13:6629:x1800422819948480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019068.829031:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019068.829039:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d3180/0x81e56358f42c21bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c21b5 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.829053:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d3180/0x81e56358f42c21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c21b5 expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.829060:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d3180/0x81e56358f42c21bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c21b5 expref: 14 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.829066:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d3180, rc 0) 00000100:00100000:2.0:1717019068.829104:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819948480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019068.829166:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019068.829175:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21bc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019068.829181:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21bc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1717019068.829213:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.829232:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.829240:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.829271:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1540 00000100:00100000:2.0:1717019068.829286:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948544 00000100:00100000:2.0:1717019068.829296:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1541 00000100:00100000:2.0:1717019068.829299:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819948544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.829369:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819948544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.829373:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1541 00000100:00100000:1.0:1717019068.829414:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.829431:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.829451:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.829458:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.829501:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948608 00000100:00100000:2.0:1717019068.829598:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1542 00000100:00100000:2.0:1717019068.829601:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819948608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.829745:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819948608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.829757:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1542 00000100:00100000:1.0:1717019068.829851:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019068.830185:0:2392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2392:1800422819948672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019068.830206:0:2392:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.830223:0:2392:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.830237:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948672 00000100:00100000:0.0:1717019068.830282:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1543 00000100:00100000:0.0:1717019068.830285:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:2392:x1800422819948672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.830792:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:2392:x1800422819948672:12345-0@lo:502:llog_process_th.0 Request processed in 505us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.830798:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1543 00000100:00100000:1.0:1717019068.830866:0:2392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2392:1800422819948672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019068.830897:0:2392:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2392:1800422819948736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1717019068.830920:0:2392:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019068.830927:0:2392:0:(client.c:2492:ptlrpc_set_wait()) set ffff880092bb9a80 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.830966:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948736 00000100:00100000:0.0:1717019068.830991:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1544 00000100:00100000:0.0:1717019068.830994:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:2392:x1800422819948736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.831259:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:2392:x1800422819948736:12345-0@lo:502:llog_process_th.0 Request processed in 263us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.831268:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1544 00000100:00100000:1.0:1717019068.831332:0:2392:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008d8d3900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2392:1800422819948736:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1717019068.831348:0:2392:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 144 count 141 00000020:01000000:2.0:1717019068.831555:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 141-143 (rc=0) 10000000:01000000:2.0:1717019068.831576:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019068.831581:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21bc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.831589:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e2d00/0x81e56358f42c21b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21bc expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019068.831595:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1717019068.831598:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1717019068.831599:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1717019068.831614:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.831618:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.831624:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.831639:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.831660:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019068.831932:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948800 00000100:00100000:0.0:1717019068.831962:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1545 00000100:00100000:0.0:1717019068.831965:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+14:6629:x1800422819948800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019068.831971:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019068.831980:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e1b00/0x81e56358f42c21ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c21c3 expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.831993:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e1b00/0x81e56358f42c21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c21c3 expref: 15 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.831999:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e1b00/0x81e56358f42c21ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c21c3 expref: 15 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.832004:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e1b00, rc 0) 00000100:00100000:2.0:1717019068.832053:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.832633:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819948800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 665us (971us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.832638:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1545 00000100:00100000:2.0:1717019068.832805:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019068.832816:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21ca expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.832822:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21ca expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.833554:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.833582:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.833591:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.833597:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948864 00000100:00100000:0.0:1717019068.833714:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1546 00000100:00100000:0.0:1717019068.833717:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819948864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.833804:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819948864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.833809:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1546 00000100:00100000:2.0:1717019068.833932:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.833954:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.833982:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.834553:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:3.0:1717019068.834643:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948928 00000100:00100000:3.0:1717019068.834672:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1547 00000100:00100000:3.0:1717019068.834675:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819948928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.835304:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819948928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 628us (1321us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019068.835309:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1547 00000100:00100000:2.0:1717019068.835419:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948928:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717019068.836441:0:2393:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1717019068.836563:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1717019068.836581:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1717019068.836586:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21ca expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.836595:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d1680/0x81e56358f42c21c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21ca expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019068.836602:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1717019068.836604:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a67c2000 from 141 10000000:01000000:2.0:1717019068.836606:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1717019068.836623:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.836628:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.836634:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.836655:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.836688:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.836699:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:3.0:1717019068.836880:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819948992 00000100:00100000:3.0:1717019068.836912:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1548 00000100:00100000:3.0:1717019068.836916:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+15:6629:x1800422819948992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1717019068.836923:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1717019068.836934:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880093e9f180/0x81e56358f42c21d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c21d1 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.836949:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880093e9f180/0x81e56358f42c21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c21d1 expref: 16 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.836955:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880093e9f180/0x81e56358f42c21d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c21d1 expref: 16 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019068.836960:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880093e9f180, rc 0) 00000100:00100000:3.0:1717019068.836987:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c549850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819948992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 71us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019068.836991:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1548 00000100:00100000:2.0:1717019068.837545:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819948992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019068.837555:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21d8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.837561:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21d8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.837595:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.837614:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.837636:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.837688:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949056 00000100:00100000:0.0:1717019068.837716:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1549 00000100:00100000:0.0:1717019068.837720:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819949056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.837809:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819949056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.837820:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1549 00000100:00100000:2.0:1717019068.837949:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.837967:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.837995:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.838015:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.838054:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949120 00000100:00100000:0.0:1717019068.838068:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1550 00000100:00100000:0.0:1717019068.838071:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819949120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.838220:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819949120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 148us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.838225:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1550 00000100:00100000:2.0:1717019068.838471:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.839887:0:2394:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2394:1800422819949184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019068.839937:0:2394:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.839965:0:2394:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced540 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.840015:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949184 00000100:00100000:0.0:1717019068.840085:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1551 00000100:00100000:0.0:1717019068.840089:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2394:x1800422819949184:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.840468:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2394:x1800422819949184:12345-0@lo:502:llog_process_th.0 Request processed in 379us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.840474:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1551 00000100:00100000:3.0:1717019068.840516:0:2394:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2394:1800422819949184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019068.840547:0:2394:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2394:1800422819949248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1717019068.840579:0:2394:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.840597:0:2394:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced540 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.840645:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949248 00000100:00100000:0.0:1717019068.840670:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1552 00000100:00100000:0.0:1717019068.840673:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2394:x1800422819949248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1717019068.840793:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+16:2394:x1800422819949248:12345-0@lo:502:llog_process_th.0 Request processed in 119us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.840799:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1552 00000100:00100000:3.0:1717019068.840881:0:2394:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job llog_process_th:627fc11f-491c-4f89-ad31-986408f4a526:2394:1800422819949248:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1717019068.840897:0:2394:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 144 count 141 00000020:01000000:2.0:1717019068.841001:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 141-143 (rc=0) 10000000:01000000:2.0:1717019068.841025:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1717019068.841030:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21d8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.841038:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d0d80/0x81e56358f42c21d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21d8 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1717019068.841055:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1717019068.841056:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1717019068.841058:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1717019068.841073:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.841078:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.841084:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.841091:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.841110:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.841130:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.841163:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949312 00000100:00100000:0.0:1717019068.841182:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1553 00000100:00100000:0.0:1717019068.841186:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+16:6629:x1800422819949312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019068.841192:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019068.841207:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8801334e0900/0x81e56358f42c21e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c21df expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.841330:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8801334e0900/0x81e56358f42c21e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c21df expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.841341:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8801334e0900/0x81e56358f42c21e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c21df expref: 17 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.841346:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e0900, rc 0) 00000100:00100000:0.0:1717019068.841449:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c54d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819949312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 262us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.841454:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1553 00000100:00100000:2.0:1717019068.841505:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019068.841514:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21e6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.841520:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21e6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1717019068.841548:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1717019068.841565:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019068.841572:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff88008aa03180 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.841617:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949376 00000100:00100000:0.0:1717019068.841630:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1554 00000100:00100000:0.0:1717019068.841632:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819949376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.841718:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c548050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819949376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019068.841801:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121c280 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.841824:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.841869:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1554 00000100:00100000:3.0:1717019068.841882:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019068.841893:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced540 going to sleep for 6 seconds 00000100:00100000:0.0:1717019068.841894:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949440 00000100:00100000:0.0:1717019068.841906:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1555 00000100:00100000:0.0:1717019068.841909:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819949440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.842291:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819949440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 381us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019068.842297:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1555 00000100:00100000:3.0:1717019068.842360:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949440:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1717019068.842924:0:2395:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:0.0:1717019068.843018:0:6629:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1717019068.843032:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1717019068.843036:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21e6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.843048:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8800a69d33c0/0x81e56358f42c21df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21e6 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1717019068.843054:0:6629:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1717019068.843056:0:6629:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6da9430 from 1 10000000:01000000:0.0:1717019068.843057:0:6629:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1717019068.843069:0:6629:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.843073:0:6629:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.843079:0:6629:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019068.843088:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.843111:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019068.843133:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b40d6600 going to sleep for 6 seconds 00000100:00100000:2.0:1717019068.843246:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949504 00000100:00100000:2.0:1717019068.843265:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1556 00000100:00100000:2.0:1717019068.843268:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+17:6629:x1800422819949504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1717019068.843280:0:8250:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019068.843289:0:8250:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a69d0240/0x81e56358f42c21f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x81e56358f42c21ed expref: -99 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.843302:0:8250:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a69d0240/0x81e56358f42c21f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x81e56358f42c21ed expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.843307:0:8250:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a69d0240/0x81e56358f42c21f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x81e56358f42c21ed expref: 18 pid: 8250 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019068.843312:0:8250:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d0240, rc 0) 00000100:00100000:2.0:1717019068.843331:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819949504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019068.843336:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1556 00000100:00100000:0.0:1717019068.843389:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1717019068.843398:0:6629:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21f4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019068.843403:0:6629:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x81e56358f42c21f4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019068.843429:0:6629:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880130f3ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1717019068.843445:0:6629:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019068.843451:0:6629:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b40d6600 going to sleep for 6 seconds 00000100:00100000:3.0:1717019068.843588:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949568 00000100:00100000:3.0:1717019068.843684:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1557 00000100:00100000:3.0:1717019068.843687:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819949568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019068.843757:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:6629:x1800422819949568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (311us total) trans 0 rc -2/-2 00000100:00100000:3.0:1717019068.843761:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1557 00000100:00100000:1.0:1717019068.843976:0:6629:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880130f3ed40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:627fc11f-491c-4f89-ad31-986408f4a526:6629:1800422819949568:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1717019068.843993:0:6629:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.203.126@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1717019068.843996:0:6629:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21f4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019068.844000:0:6629:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.126@tcp lock: ffff8801334e1680/0x81e56358f42c21ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x81e56358f42c21f4 expref: -99 pid: 6629 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019069.298497:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019069.301528:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838689984 00000100:00100000:1.0:1717019069.302911:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1558 00000100:00100000:1.0:1717019069.302920:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+7:4633:x1800422838689984:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1717019069.302937:0:8248:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717019069.302958:0:8248:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c79dd40/0x81e56358f42c21fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3690d expref: -99 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019069.302987:0:8248:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c79dd40/0x81e56358f42c21fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3690d expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019069.303005:0:8248:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c79dd40/0x81e56358f42c21fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3690d expref: 8 pid: 8248 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019069.303012:0:8248:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79dd40, rc 0) 00000100:00100000:1.0:1717019069.303076:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838689984:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 158us (4585us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019069.303082:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1558 00000100:00100000:2.0:1717019069.307578:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019069.307760:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690048 00000100:00100000:3.0:1717019069.307861:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1559 00000100:00100000:3.0:1717019069.307868:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838690048:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019069.308021:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838690048:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 154us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019069.308028:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1559 00000100:00100000:0.0:1717019069.309162:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717019069.309237:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690112 00000100:00100000:1.0:1717019069.312196:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1560 00000100:00100000:1.0:1717019069.312206:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838690112:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1717019069.312463:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838690112:12345-192.168.203.26@tcp:503:ll_cfg_requeue.0 Request processed in 259us (3303us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019069.312470:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1560 00000100:00100000:1.0:1717019069.327321:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019069.327416:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690176 00000100:00100000:3.0:1717019069.327476:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1561 00000100:00100000:3.0:1717019069.327481:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:28405:x1800422838690176:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717019069.328203:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea98050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:28405:x1800422838690176:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 719us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019069.328209:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1561 00000100:00100000:0.0:1717019069.336276:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019069.336527:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690240 00000100:00100000:3.0:1717019069.336569:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1562 00000100:00100000:3.0:1717019069.336575:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:28405:x1800422838690240:12345-192.168.203.26@tcp:502:llog_process_th.0 00000100:00100000:3.0:1717019069.336875:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:28405:x1800422838690240:12345-192.168.203.26@tcp:502:llog_process_th.0 Request processed in 300us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019069.336883:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1562 00000100:00100000:2.0:1717019069.342618:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019069.342706:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819949632:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.342739:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2351c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819949696:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.342739:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019069.342761:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819949888:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.342764:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019069.342780:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019069.342782:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819949952:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.342792:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1717019069.342794:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019069.342796:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819949824:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.342804:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1717019069.342807:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819949760:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.342810:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019069.342843:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019069.342852:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949888 00000100:00100000:3.0:1717019069.342862:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949824 00000100:00100000:2.0:1717019069.342881:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1717019069.342884:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1717019069.342886:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819949888:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.342887:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819949824:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.342915:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819949824:12345-0@lo:400:kworker/u8:2.0 Request processed in 27us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019069.342918:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819949888:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019069.342919:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1141 00000100:00100000:2.0:1717019069.342927:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1140 00000100:00100000:3.0:1717019069.342944:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690304 00000100:00100000:2.0:1717019069.342944:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949696 00000100:00100000:3.0:1717019069.342955:0:8249:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949632 00000100:00100000:2.0:1717019069.342960:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949952 00000100:00100000:3.0:1717019069.342962:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1563 00000100:00100000:3.0:1717019069.342965:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+8:4633:x1800422838690304:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 00000100:00100000:2.0:1717019069.342970:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819949760 00010000:00010000:3.0:1717019069.342971:0:8249:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00000100:00100000:2.0:1717019069.342980:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1717019069.342983:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2351300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819949696:12345-0@lo:400:kworker/u8:2.0 00010000:00010000:3.0:1717019069.342984:0:8249:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880093e9cb40/0x81e56358f42c2202 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36914 expref: -99 pid: 8249 timeout: 0 lvb_type: 0 00010000:00000080:2.0:1717019069.342993:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a2351300 x1800422819949696/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:414/0 lens 224/224 e 0 to 0 dl 1717019149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00010000:00010000:3.0:1717019069.343001:0:8249:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880093e9cb40/0x81e56358f42c2202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36914 expref: 9 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019069.343007:0:8249:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880093e9cb40/0x81e56358f42c2202 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36914 expref: 9 pid: 8249 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019069.343013:0:8249:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880093e9cb40, rc 0) 00000100:00100000:2.0:1717019069.343014:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2351300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819949696:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019069.343018:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 850 00000100:00100000:2.0:1717019069.343025:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1717019069.343028:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a23576c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819949952:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:2.0:1717019069.343034:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a23576c0 x1800422819949952/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:414/0 lens 224/224 e 0 to 0 dl 1717019149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1717019069.343035:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838690304:12345-192.168.203.26@tcp:101:ll_cfg_requeue.0 Request processed in 69us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019069.343039:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1563 00000100:00100000:2.0:1717019069.343048:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a23576c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819949952:12345-0@lo:400:kworker/u8:2.0 Request processed in 20us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019069.343050:0:8249:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1564 00000100:00100000:3.0:1717019069.343052:0:8249:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819949632:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.343052:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 851 00000100:00100000:2.0:1717019069.343061:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 852 00000100:00100000:2.0:1717019069.343063:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2354c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819949760:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.343067:0:8249:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819949632:12345-0@lo:400:kworker/u8:2.0 Request processed in 14us (328us total) trans 0 rc 0/0 00010000:00000080:2.0:1717019069.343069:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a2354c00 x1800422819949760/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:414/0 lens 224/224 e 0 to 0 dl 1717019149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1717019069.343070:0:8249:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1564 00000100:00100000:2.0:1717019069.343082:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2354c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819949760:12345-0@lo:400:kworker/u8:2.0 Request processed in 18us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019069.343086:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 852 00000100:00100000:3.0:1717019069.343094:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2350000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819949760:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.343101:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2351c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819949696:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019069.343106:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2355580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819949952:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.343115:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819949824:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.343121:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819949888:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019069.343127:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819949632:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019069.345710:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019069.346410:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690368 00000100:00100000:3.0:1717019069.346450:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1565 00000100:00100000:3.0:1717019069.346456:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838690368:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1717019069.346595:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:4633:x1800422838690368:12345-192.168.203.26@tcp:501:ll_cfg_requeue.0 Request processed in 138us (893us total) trans 0 rc -2/-2 00000100:00100000:3.0:1717019069.346601:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1565 00010000:00010000:1.0:1717019069.816388:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019070.818309:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019071.820790:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019072.822168:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019072.859962:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1717019072.859980:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008121b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819950016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1717019072.860028:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019072.860083:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950016 00000100:00100000:2.0:1717019072.860112:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 636 00000100:00100000:2.0:1717019072.860115:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2355580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819950016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1717019072.860151:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:2.0:1717019072.860185:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2355580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819950016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019072.860190:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 636 00000100:00100000:3.0:1717019072.860203:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008121b440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819950016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019073.278744:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019073.278781:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019073.278803:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690496 00000100:00100000:0.0:1717019073.278815:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019073.278855:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 853 00000100:00100000:2.0:1717019073.278860:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12cff408-c572-49fa-81b0-09052c8e7f41+66:1836:x1800422838690496:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.278863:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690624 00000100:00100000:0.0:1717019073.278869:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00010000:00000080:2.0:1717019073.278883:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880130f3df00 x1800422838690496/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 224/224 e 0 to 0 dl 1717019153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:4.0' 00000100:00100000:2.0:1717019073.278921:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12cff408-c572-49fa-81b0-09052c8e7f41+66:1836:x1800422838690496:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 61us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019073.278927:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 853 00000100:00100000:3.0:1717019073.278950:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690560 00000100:00100000:2.0:1717019073.278957:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1142 00000100:00100000:2.0:1717019073.278962:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838690624:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.278966:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1143 00000100:00100000:3.0:1717019073.278970:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880130f3e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838690560:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019073.278979:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838690624:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 18us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019073.278984:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1142 00000100:00100000:3.0:1717019073.278992:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880130f3e880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838690560:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 22us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019073.278997:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1143 00000100:00100000:3.0:1717019073.279012:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690432 00000100:00100000:3.0:1717019073.279333:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1566 00000100:00100000:3.0:1717019073.279338:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+9:1836:x1800422838690432:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019073.279372:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:461e9689-0dac-4669-87c3-00abdddc539f+9:1836:x1800422838690432:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 34us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019073.279377:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1566 00000400:00000080:1.0:1717019073.500185:0:2910:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717019073.500188:0:2910:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 23f: Append with low on space: repeat and remove EXT comp ========================================================== 17:44:33 (1717019073) 00000100:00100000:2.0:1717019073.532482:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019073.533880:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690688 00000100:00100000:0.0:1717019073.533928:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 393 00000100:00100000:0.0:1717019073.533934:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+66:28546:x1800422838690688:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:0.0:1717019073.533949:0:9645:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019073.533964:0:9645:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0000/0x81e56358f42c2209 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3691b expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534006:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534022:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534031:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534042:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534048:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534067:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534144:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534150:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534154:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534159:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e2880 already unused, calling callback (ffffffffa1346360) 00010000:00010000:0.0:1717019073.534161:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534166:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534174:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:0.0:1717019073.534176:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1717019073.534179:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534182:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2880/0x81e56358f42c2210 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534191:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534203:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534208:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534211:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e0240 already unused, calling callback (ffffffffa1346360) 00010000:00010000:0.0:1717019073.534213:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534217:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534223:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa71facfe (ffff88008a988c00) 00010000:00010000:0.0:1717019073.534224:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1717019073.534225:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534229:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0240/0x81e56358f42c2217 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534269:0:9645:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0000/0x81e56358f42c2209 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3691b expref: 67 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534276:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0000/0x81e56358f42c2209 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3691b expref: 67 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.534282:0:9645:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e0000, rc 0) 00010000:00000080:0.0:1717019073.534290:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008121b440 x1800422838690688/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 584/640 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 301/0 job:'bash.0' 00000100:00100000:0.0:1717019073.534347:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121b440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+66:28546:x1800422838690688:12345-192.168.203.26@tcp:101:bash.0 Request processed in 412us (1868us total) trans 0 rc 301/301 00000100:00100000:0.0:1717019073.534353:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 393 00000100:00100000:0.0:1717019073.536126:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:1.0:1717019073.536169:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690752 00000100:00100000:1.0:1717019073.536196:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 394 00000100:00100000:1.0:1717019073.536200:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137149300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+66:28546:x1800422838690752:12345-192.168.203.26@tcp:101:bash.0 00010000:00010000:1.0:1717019073.536212:0:9645:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1717019073.536223:0:9645:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c6c0/0x81e56358f42c221e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36922 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.536267:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c2225 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.536276:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c2225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.536284:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c2225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1717019073.536329:0:9645:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 14848 00000004:00200000:1.0:1717019073.536332:0:9645:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 54 stripe count 1 MDT count 1 00000004:00010000:1.0:1717019073.536344:0:9645:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c2225 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.536359:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79c6c0/0x81e56358f42c221e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36922 expref: 68 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.536369:0:9645:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c2225 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36922 expref: 67 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.536387:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:1.0:1717019073.536389:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1717019073.536391:0:9645:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c79cfc0, rc 0) 00010000:00000080:1.0:1717019073.536395:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880137149300 x1800422838690752/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 576/688 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 0/0 job:'bash.0' 00000100:00100000:1.0:1717019073.536432:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137149300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+67:28546:x1800422838690752:12345-192.168.203.26@tcp:101:bash.0 Request processed in 231us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019073.536437:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 394 00000100:00100000:2.0:1717019073.543815:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019073.543870:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690816 00000100:00100000:2.0:1717019073.543877:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:3.0:1717019073.543900:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838690944 00000100:00100000:3.0:1717019073.543910:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 395 00000100:00100000:3.0:1717019073.543914:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12cff408-c572-49fa-81b0-09052c8e7f41+68:1833:x1800422838690816:12345-192.168.203.26@tcp:41:mkdir.0 00000100:00100000:2.0:1717019073.543914:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 396 00000100:00100000:2.0:1717019073.543919:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008121d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+68:28706:x1800422838690944:12345-192.168.203.26@tcp:36:mkdir.0 00000004:00000024:3.0:1717019073.543943:0:17732:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 8257536 pending 0 free 2257321984 avail 2255224832 00010000:00010000:2.0:1717019073.543947:0:8254:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00000080:3.0:1717019073.543960:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008121c280 x1800422838690816/t0(0) o41->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 224/368 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 0/0 job:'mkdir.0' 00010000:00010000:2.0:1717019073.543963:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c79cfc0/0x81e56358f42c2225 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36922 expref: 68 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.543973:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:2.0:1717019073.543975:0:8254:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1717019073.543995:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121c280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12cff408-c572-49fa-81b0-09052c8e7f41+67:1833:x1800422838690816:12345-192.168.203.26@tcp:41:mkdir.0 Request processed in 81us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019073.544000:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 395 00010000:00010000:2.0:1717019073.544043:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544051:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544057:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544064:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544067:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544070:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1717019073.544685:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cfc:0x0]: returning size 512 00010000:00010000:2.0:1717019073.544695:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544701:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544706:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544711:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0900 already unused, calling callback (ffffffffa1346360) 00010000:00010000:2.0:1717019073.544714:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544719:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544726:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:2.0:1717019073.544728:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1717019073.544730:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.544734:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0900/0x81e56358f42c222c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1717019073.544742:0:8254:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff88008121d580 reply state ffff880132e67800 transno 12884902049 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00000080:2.0:1717019073.544759:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008121d580 x1800422838690944/t12884902049(0) o36->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 512/448 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 0/0 job:'mkdir.0' 00000100:00100000:2.0:1717019073.544798:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008121d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+68:28706:x1800422838690944:12345-192.168.203.26@tcp:36:mkdir.0 Request processed in 879us (921us total) trans 12884902049 rc 0/0 00000100:00100000:2.0:1717019073.544808:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 396 00010000:00010000:1.0:1717019073.546043:0:2839:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.546052:0:2839:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.546057:0:2839:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.546062:0:2839:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d21c0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717019073.546064:0:2839:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.546069:0:2839:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.546078:0:2839:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa71facfe (ffff88007d6e6200) 00010000:00010000:1.0:1717019073.546080:0:2839:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717019073.546081:0:2839:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.546085:0:2839:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d21c0/0x81e56358f42c2233 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1717019073.551451:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019073.551529:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691008 00000100:00100000:2.0:1717019073.551567:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 397 00000100:00100000:2.0:1717019073.551572:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+67:28707:x1800422838691008:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1717019073.551589:0:8254:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019073.551602:0:8254:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0000/0x81e56358f42c223a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36929 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551641:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551651:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551659:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551670:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551675:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551680:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551781:0:8254:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d3600/0x81e56358f42c224f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551796:0:8254:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d3600/0x81e56358f42c224f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551803:0:8254:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d3600/0x81e56358f42c224f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1717019073.551849:0:8254:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cfc:0x0]: returning size 512 00000004:00200000:2.0:1717019073.551852:0:8254:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1717019073.551864:0:8254:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d3600/0x81e56358f42c224f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551872:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551876:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551880:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551885:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2d00 already unused, calling callback (ffffffffa1346360) 00010000:00010000:2.0:1717019073.551888:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551893:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551900:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff880099a30900) 00010000:00010000:2.0:1717019073.551902:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1717019073.551909:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551913:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2d00/0x81e56358f42c2241 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551921:0:8254:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551925:0:8254:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551929:0:8254:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551932:0:8254:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1f80 already unused, calling callback (ffffffffa1346360) 00010000:00010000:2.0:1717019073.551934:0:8254:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551938:0:8254:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551944:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa71facfe (ffff88007d6e6b00) 00010000:00010000:2.0:1717019073.551945:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1717019073.551946:0:8254:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551950:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1f80/0x81e56358f42c2248 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa71facfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551973:0:8254:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0000/0x81e56358f42c223a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36929 expref: 69 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551987:0:8254:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d3600/0x81e56358f42c224f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36929 expref: 68 pid: 8254 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.551992:0:8254:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfc:0x0].0x0 (ffff88007d6e6e00) 00010000:00010000:2.0:1717019073.551994:0:8254:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1717019073.551995:0:8254:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d3600, rc 0) 00010000:00000080:2.0:1717019073.551999:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013714d580 x1800422838691008/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 584/640 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1717019073.552038:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714d580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+68:28707:x1800422838691008:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 466us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019073.552044:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 397 00000100:00100000:3.0:1717019073.556285:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019073.556918:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691072 00000100:00100000:2.0:1717019073.557708:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 398 00000100:00100000:2.0:1717019073.557718:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2351c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+68:28707:x1800422838691072:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1717019073.557733:0:9645:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019073.557852:0:9645:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1b00/0x81e56358f42c2256 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36930 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557897:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557907:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557915:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557934:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557939:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557944:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.557996:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558001:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558006:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558011:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d1200 already unused, calling callback (ffffffffa1346360) 00010000:00010000:2.0:1717019073.558014:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558490:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558502:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfc:0x0].0x0 (ffff88007d6e6e00) 00010000:00010000:2.0:1717019073.558504:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1717019073.558506:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558519:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1200/0x81e56358f42c225d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558527:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558532:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558536:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558540:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d06c0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:2.0:1717019073.558541:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558546:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558551:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfc:0x0].0xa71fad10 (ffff88007d6e6800) 00010000:00010000:2.0:1717019073.558552:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1717019073.558554:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558557:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d06c0/0x81e56358f42c2264 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558594:0:9645:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1b00/0x81e56358f42c2256 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36930 expref: 69 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558608:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d1b00/0x81e56358f42c2256 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36930 expref: 69 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.558616:0:9645:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a69d1b00, rc 0) 00010000:00000080:2.0:1717019073.558620:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a2351c80 x1800422838691072/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 584/640 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:2.0:1717019073.558679:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2351c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+68:28707:x1800422838691072:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 961us (2396us total) trans 0 rc 301/301 00000100:00100000:2.0:1717019073.558685:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 398 00000100:00100000:3.0:1717019073.560982:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019073.561236:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691200 00000100:00100000:2.0:1717019073.561265:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 399 00000100:00100000:2.0:1717019073.561269:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+68:28707:x1800422838691200:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:2.0:1717019073.561282:0:9645:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1717019073.561294:0:9645:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2880/0x81e56358f42c226b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a36937 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.561399:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.561409:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.561416:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.561425:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.561436:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.561441:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562656:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562667:0:9645:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562675:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1717019073.562682:0:9645:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cfd:0x0]: returning size 0 00010000:00010000:3.0:1717019073.562700:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562705:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562710:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562721:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d0fc0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:3.0:1717019073.562723:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562728:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562737:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfc:0x0].0x0 (ffff88007d6e6e00) 00010000:00010000:3.0:1717019073.562739:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1717019073.562741:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562745:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d0fc0/0x81e56358f42c2272 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00000004:00010000:3.0:1717019073.562755:0:9645:0:(mdt_handler.c:3992:mdt_save_lock()) ### save lock request ffff8800a2350000 reply state ffff88008f23e000 transno 12884902050 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562780:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2880/0x81e56358f42c226b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 71 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562793:0:9645:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 70 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.562798:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfd:0x0].0x0 (ffff880132059300) 00010000:00010000:3.0:1717019073.562799:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1717019073.562800:0:9645:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880093e9c6c0, rc 0) 00010000:00000080:3.0:1717019073.562804:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a2350000 x1800422838691200/t12884902050(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 528/600 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:3.0:1717019073.562885:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2350000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+71:28707:x1800422838691200:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 1615us (1905us total) trans 12884902050 rc 0/0 00000100:00100000:3.0:1717019073.562892:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 399 00010000:00010000:1.0:1717019073.563968:0:2838:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.563976:0:2838:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.563985:0:2838:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.563996:0:2838:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a69d2ac0 already unused, calling callback (ffffffffa1346360) 00010000:00010000:1.0:1717019073.563998:0:2838:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.564001:0:2838:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.564008:0:2838:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfc:0x0].0xa71fad10 (ffff88007d6e6200) 00010000:00010000:1.0:1717019073.564009:0:2838:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1717019073.564010:0:2838:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1717019073.564013:0:2838:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a69d2ac0/0x81e56358f42c2279 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2cfc:0x0].0xa71fad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019073.565011:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019073.565050:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691328 00000100:00100000:0.0:1717019073.565077:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 400 00000100:00100000:0.0:1717019073.565081:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2353440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+70:28707:x1800422838691328:12345-192.168.203.26@tcp:101:lfs.0 00010000:00010000:0.0:1717019073.565097:0:9645:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1717019073.565108:0:9645:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2f40/0x81e56358f42c228e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe1aedd3f13a3693e expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.565178:0:9645:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.565189:0:9645:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 71 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.565193:0:9645:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.565215:0:9645:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 71 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1717019073.565224:0:9645:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 71 pid: 9645 timeout: 2206 lvb_type: 0 00000100:00100000:0.0:1717019073.565242:0:9645:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013714c280 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9645:1800422819950080:192.168.203.26@tcp:104: 00000100:00100000:0.0:1717019073.565291:0:9645:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4ced180 going to sleep for 6 seconds 00000100:00100000:2.0:1717019073.566368:0:9645:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013714c280 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9645:1800422819950080:192.168.203.26@tcp:104: 00010000:00010000:2.0:1717019073.566383:0:9645:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1717019073.566999:0:2846:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019073.567066:0:8093:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691392 00010000:00010000:2.0:1717019073.567084:0:8093:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 72 pid: 9645 timeout: 2206 lvb_type: 0 00000100:00100000:2.0:1717019073.567128:0:8093:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 75487 00000100:00100000:2.0:1717019073.567132:0:8093:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2357200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12cff408-c572-49fa-81b0-09052c8e7f41+72:1833:x1800422838691392:12345-192.168.203.26@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1717019073.567142:0:8093:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1717019073.567145:0:8093:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 72 pid: 9645 timeout: 2206 lvb_type: 0 00010000:00010000:2.0:1717019073.567152:0:8093:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 72 pid: 9645 timeout: 2206 lvb_type: 0 00010000:00010000:2.0:1717019073.567169:0:8093:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff880093e9c6c0/0x81e56358f42c2280 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfd:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a36937 expref: 72 pid: 9645 timeout: 2206 lvb_type: 0 00010000:00010000:2.0:1717019073.567179:0:8093:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfd:0x0].0x0 (ffff880132059300) 00010000:00010000:2.0:1717019073.567187:0:8093:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.567193:0:8093:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.567198:0:8093:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1717019073.567220:0:8093:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1717019073.567244:0:8093:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2357200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:12cff408-c572-49fa-81b0-09052c8e7f41+71:1833:x1800422838691392:12345-192.168.203.26@tcp:103:ldlm_bl_02.0 Request processed in 111us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019073.567249:0:8093:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 75487 00010000:00010000:3.0:1717019073.567326:0:9645:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019073.567334:0:9645:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1717019073.567348:0:9645:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x2cfd:0x0]: returning size 0 00010000:00010000:1.0:1717019073.824214:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019074.348029:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819950272:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348029:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2354740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819950208:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019074.348043:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819950336:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348081:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019074.348082:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019074.348139:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019074.348143:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819950464:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348165:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019074.348169:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950208 00000100:00100000:3.0:1717019074.348175:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950272 00000100:00100000:2.0:1717019074.348178:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1717019074.348182:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819950144:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019074.348195:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950464 00000100:00100000:2.0:1717019074.348201:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019074.348202:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 854 00000100:00100000:0.0:1717019074.348206:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819950272:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019074.348207:0:8489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 855 00000100:00100000:2.0:1717019074.348210:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819950400:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019074.348211:0:8489:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800812184c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819950208:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019074.348215:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 856 00000100:00100000:3.0:1717019074.348218:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819950464:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:0.0:1717019074.348220:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009058bdc0 x1800422819950272/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:419/0 lens 224/224 e 0 to 0 dl 1717019154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717019074.348222:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:1.0:1717019074.348222:0:8489:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800812184c0 x1800422819950208/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:419/0 lens 224/224 e 0 to 0 dl 1717019154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00010000:00000080:3.0:1717019074.348227:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008b82ed40 x1800422819950464/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:419/0 lens 224/224 e 0 to 0 dl 1717019154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717019074.348239:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950336 00000100:00100000:0.0:1717019074.348253:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058bdc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819950272:12345-0@lo:400:kworker/u8:2.0 Request processed in 47us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019074.348255:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819950464:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (90us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019074.348255:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950400 00000100:00100000:1.0:1717019074.348255:0:8489:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800812184c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819950208:12345-0@lo:400:kworker/u8:2.0 Request processed in 43us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019074.348258:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 854 00000100:00100000:1.0:1717019074.348261:0:8489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 855 00000100:00100000:3.0:1717019074.348263:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 856 00000100:00100000:2.0:1717019074.348265:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1144 00000100:00100000:2.0:1717019074.348268:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819950336:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019074.348279:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1145 00000100:00100000:0.0:1717019074.348282:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819950400:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348293:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714aac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819950336:12345-0@lo:400:kworker/u8:2.0 Request processed in 25us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019074.348299:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819950272:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348307:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1144 00000100:00100000:1.0:1717019074.348307:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819950336:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019074.348307:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82cc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819950400:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (84us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019074.348311:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1145 00000100:00100000:2.0:1717019074.348322:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950144 00000100:00100000:2.0:1717019074.348342:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1717019074.348345:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819950144:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348364:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012ea9c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819950144:12345-0@lo:400:kworker/u8:2.0 Request processed in 19us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019074.348368:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1567 00000100:00100000:2.0:1717019074.348389:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819950144:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348397:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819950400:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348403:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2354740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819950208:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019074.348409:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819950464:0@lo:400:kworker/u8:2.0 00010000:00010000:1.0:1717019074.826437:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019075.828003:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019076.831701:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1717019077.832290:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019077.868341:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009058e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019077.868391:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019077.868477:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950528 00000100:00100000:2.0:1717019077.868512:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 637 00000100:00100000:2.0:1717019077.868516:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013714c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819950528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1717019077.868541:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:2.0:1717019077.868577:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013714c280 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819950528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 61us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019077.868581:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 637 00000100:00100000:1.0:1717019077.868613:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009058e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819950528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019078.286360:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019078.286405:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019078.286437:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019078.286464:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019078.286474:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691648 00000100:00100000:0.0:1717019078.286507:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691456 00000100:00100000:2.0:1717019078.286508:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691584 00000100:00100000:2.0:1717019078.286523:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1146 00000100:00100000:2.0:1717019078.286527:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b06880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838691648:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717019078.286528:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1568 00000100:00100000:0.0:1717019078.286532:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1836:x1800422838691456:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019078.286533:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1147 00000100:00100000:3.0:1717019078.286538:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838691584:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1717019078.286618:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691520 00000100:00100000:1.0:1717019078.286639:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 857 00000100:00100000:1.0:1717019078.286642:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880132b050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12cff408-c572-49fa-81b0-09052c8e7f41+71:1836:x1800422838691520:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00010000:00000080:1.0:1717019078.286654:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880132b050c0 x1800422838691520/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:423/0 lens 224/224 e 0 to 0 dl 1717019158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:4.0' 00000100:00100000:0.0:1717019078.286860:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1836:x1800422838691456:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 327us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019078.286866:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1568 00000100:00100000:2.0:1717019078.286912:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b06880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838691648:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 383us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019078.286917:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b004c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838691584:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 378us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019078.286923:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1146 00000100:00100000:3.0:1717019078.286926:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1147 00000100:00100000:1.0:1717019078.287119:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880132b050c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:12cff408-c572-49fa-81b0-09052c8e7f41+71:1836:x1800422838691520:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 475us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019078.287124:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 857 00000001:00080000:0.0:1717019078.329943:0:8305:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902050 is committed 00010000:00010000:3.0:1717019078.834028:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1717019079.358180:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009058e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819950592:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019079.358192:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819950784:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.358246:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019079.358246:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019079.358266:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2354740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2855:1800422819950720:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.358269:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819950848:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.358287:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2854:1800422819950656:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019079.358298:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019079.358317:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950720 00000100:00100000:2.0:1717019079.358334:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950592 00000100:00100000:1.0:1717019079.358345:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1717019079.358349:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b82e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2855:x1800422819950720:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019079.358352:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1569 00000100:00100000:2.0:1717019079.358355:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819950592:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:1.0:1717019079.358365:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008b82e3c0 x1800422819950720/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:424/0 lens 224/224 e 0 to 0 dl 1717019159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717019079.358381:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819950592:12345-0@lo:400:kworker/u8:2.0 Request processed in 26us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019079.358386:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1569 00000100:00100000:1.0:1717019079.358390:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b82e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2855:x1800422819950720:12345-0@lo:400:kworker/u8:2.0 Request processed in 40us (92us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019079.358395:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 858 00000100:00100000:1.0:1717019079.358410:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019079.358419:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2354740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:2855:1800422819950720:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.358420:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2854:1800422819950912:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.358446:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019079.358466:0:8489:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950656 00000100:00100000:1.0:1717019079.358492:0:8489:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950912 00000100:00100000:1.0:1717019079.358504:0:8489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 859 00000100:00100000:1.0:1717019079.358507:0:8489:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2854:x1800422819950656:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:1.0:1717019079.358516:0:8489:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008d8d3900 x1800422819950656/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:424/0 lens 224/224 e 0 to 0 dl 1717019159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:2.0:1717019079.358531:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 860 00000100:00100000:1.0:1717019079.358537:0:8489:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d3900 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2854:x1800422819950656:12345-0@lo:400:kworker/u8:2.0 Request processed in 29us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019079.358539:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2854:x1800422819950912:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.358542:0:8489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 859 00010000:00000080:2.0:1717019079.358550:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008d8d4280 x1800422819950912/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:424/0 lens 224/224 e 0 to 0 dl 1717019159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1717019079.358561:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:2854:1800422819950656:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019079.358572:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d4280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2854:x1800422819950912:12345-0@lo:400:kworker/u8:2.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019079.358573:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:2854:1800422819950912:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019079.358577:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 860 00000100:00100000:3.0:1717019079.359522:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950784 00000100:00100000:3.0:1717019079.359561:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1148 00000100:00100000:3.0:1717019079.359565:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9acc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819950784:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019079.359575:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019079.359588:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950848 00000100:00100000:1.0:1717019079.359598:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009058e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819950592:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019079.359601:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9acc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819950784:12345-0@lo:400:kworker/u8:2.0 Request processed in 36us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019079.359607:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1148 00000100:00100000:2.0:1717019079.359714:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1149 00000100:00100000:2.0:1717019079.359719:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008d8d63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819950848:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019079.359726:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819950784:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019079.359747:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008d8d63c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819950848:12345-0@lo:400:kworker/u8:2.0 Request processed in 28us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019079.359751:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1149 00000100:00100000:1.0:1717019079.359788:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819950848:0@lo:400:kworker/u8:2.0 00010000:00010000:1.0:1717019079.836060:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019080.838153:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019081.840126:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019082.841994:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1717019082.876853:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009058e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819950976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1717019082.876916:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019082.877216:0:8081:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819950976 00000100:00100000:3.0:1717019082.877254:0:8081:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 638 00000100:00100000:3.0:1717019082.877257:0:8081:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008b828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819950976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1717019082.877281:0:8081:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1717019082.877317:0:8081:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008b828000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2855:x1800422819950976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019082.877322:0:8081:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 638 00000100:00100000:2.0:1717019082.877345:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009058e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2855:1800422819950976:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019083.294627:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019083.294669:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019083.294693:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019083.294718:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019083.294756:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691712 00000100:00100000:0.0:1717019083.294803:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1570 00000100:00100000:0.0:1717019083.294808:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838691712:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717019083.294908:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838691712:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 100us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019083.294915:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1570 00000100:00100000:0.0:1717019083.295046:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691904 00000100:00100000:0.0:1717019083.295078:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691840 00000100:00100000:2.0:1717019083.295085:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691776 00000100:00100000:0.0:1717019083.295092:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1150 00000100:00100000:0.0:1717019083.295096:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9af200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838691904:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:3.0:1717019083.295098:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1151 00000100:00100000:3.0:1717019083.295107:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69c0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1835:x1800422838691840:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:2.0:1717019083.295112:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 861 00000100:00100000:2.0:1717019083.295116:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008e9adf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12cff408-c572-49fa-81b0-09052c8e7f41+69:1836:x1800422838691776:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:0.0:1717019083.295123:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9af200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838691904:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 27us (429us total) trans 0 rc 0/0 00010000:00000080:2.0:1717019083.295132:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008e9adf00 x1800422838691776/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:428/0 lens 224/224 e 0 to 0 dl 1717019163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:4.0' 00000100:00100000:3.0:1717019083.295135:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69c0980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+549:1835:x1800422838691840:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019083.295138:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1150 00000100:00100000:3.0:1717019083.295142:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1151 00000100:00100000:2.0:1717019083.295154:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008e9adf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:12cff408-c572-49fa-81b0-09052c8e7f41+69:1836:x1800422838691776:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 38us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019083.295159:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 861 00010000:00010000:0.0:1717019083.844571:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019084.364432:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2854:1800422819951168:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019084.364494:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019084.364537:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1717019084.364541:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951232:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019084.364558:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019084.364581:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951232 00000100:00100000:1.0:1717019084.364601:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2853:1800422819951104:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019084.364604:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1152 00000100:00100000:3.0:1717019084.364607:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951232:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019084.364625:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019084.364638:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296ed40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951232:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (79us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019084.364638:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2354740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2853:1800422819951360:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019084.364643:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1152 00000100:00100000:1.0:1717019084.364651:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019084.364661:0:2853:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1717019084.364671:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819951040:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019084.364676:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951168 00000100:00100000:3.0:1717019084.364683:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951232:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019084.364696:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951104 00000100:00100000:2.0:1717019084.364704:0:17732:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951360 00000100:00100000:3.0:1717019084.364707:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 862 00000100:00100000:3.0:1717019084.364710:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880092968980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2854:x1800422819951168:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019084.364716:0:17732:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 863 00000100:00100000:2.0:1717019084.364719:0:17732:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009058e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2853:x1800422819951104:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:3.0:1717019084.364720:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880092968980 x1800422819951168/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:429/0 lens 224/224 e 0 to 0 dl 1717019164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00010000:00000080:2.0:1717019084.364729:0:17732:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009058e880 x1800422819951104/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:429/0 lens 224/224 e 0 to 0 dl 1717019164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1717019084.364744:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880092968980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:2854:x1800422819951168:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019084.364749:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 862 00000100:00100000:2.0:1717019084.364752:0:17732:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009058e880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2853:x1800422819951104:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019084.364757:0:17732:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 863 00000100:00100000:3.0:1717019084.364761:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 864 00000100:00100000:3.0:1717019084.364764:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801353984c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2853:x1800422819951360:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:3.0:1717019084.364770:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801353984c0 x1800422819951360/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:429/0 lens 224/224 e 0 to 0 dl 1717019164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1717019084.364787:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801353984c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:2853:x1800422819951360:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019084.364791:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 864 00000100:00100000:1.0:1717019084.365096:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019084.365272:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2854:1800422819951168:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019084.365421:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819951296:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019084.365440:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019084.365577:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951040 00000100:00100000:0.0:1717019084.365600:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1571 00000100:00100000:0.0:1717019084.365603:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819951040:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019084.365626:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:2853:x1800422819951040:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (531us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019084.365630:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1571 00000100:00100000:1.0:1717019084.365686:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2853:1800422819951104:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019084.365693:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2354740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2853:1800422819951360:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019084.365704:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2355a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:627fc11f-491c-4f89-ad31-986408f4a526:2853:1800422819951040:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019084.365739:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951296 00000100:00100000:2.0:1717019084.365758:0:14898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1153 00000100:00100000:2.0:1717019084.365761:0:14898:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819951296:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019084.365784:0:14898:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2853:x1800422819951296:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019084.365965:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2853:1800422819951296:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019084.366022:0:14898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1153 00010000:00010000:3.0:1717019084.846008:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019085.848489:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019086.850086:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019087.852182:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1717019087.884117:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1717019087.884168:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019087.884265:0:13505:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951424 00000100:00100000:2.0:1717019087.884304:0:13505:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 639 00000100:00100000:2.0:1717019087.884308:0:13505:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009296af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1717019087.884332:0:13505:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:2.0:1717019087.884504:0:13505:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009296af80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 195us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019087.884509:0:13505:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 639 00000100:00100000:3.0:1717019087.884587:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008b82c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019088.303935:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019088.303979:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019088.304010:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019088.304074:0:2847:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019088.304120:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692160 00000100:00100000:0.0:1717019088.304154:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692096 00000100:00100000:0.0:1717019088.304172:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1154 00000100:00100000:1.0:1717019088.304186:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838691968 00000100:00100000:1.0:1717019088.304233:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1572 00000100:00100000:1.0:1717019088.304238:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1836:x1800422838691968:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1717019088.304291:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097578850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1836:x1800422838691968:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 53us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019088.304297:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1572 00000100:00100000:1.0:1717019088.304401:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1155 00000100:00100000:0.0:1717019088.304403:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838692160:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1717019088.304406:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69c17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838692096:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00000100:00100000:1.0:1717019088.304422:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69c17c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1836:x1800422838692096:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 17us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019088.304427:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1155 00000100:00100000:0.0:1717019088.304432:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69c50c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838692160:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 30us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019088.304437:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1154 00000100:00100000:3.0:1717019088.304468:0:8254:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692032 00000100:00100000:3.0:1717019088.304500:0:8254:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 865 00000100:00100000:3.0:1717019088.304504:0:8254:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+69:1836:x1800422838692032:12345-192.168.203.26@tcp:400:kworker/u8:4.0 00010000:00000080:3.0:1717019088.304516:0:8254:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a69c5a40 x1800422838692032/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:433/0 lens 224/224 e 0 to 0 dl 1717019168 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:4.0' 00000100:00100000:3.0:1717019088.304537:0:8254:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69c5a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:12cff408-c572-49fa-81b0-09052c8e7f41+69:1836:x1800422838692032:12345-192.168.203.26@tcp:400:kworker/u8:4.0 Request processed in 33us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019088.304542:0:8254:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 865 00010000:00010000:1.0:1717019088.856042:0:6619:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019089.372143:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819951488:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019089.372194:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019089.373289:0:8250:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951488 00000100:00100000:0.0:1717019089.373304:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819951552:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.373318:0:8250:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1573 00000100:00100000:1.0:1717019089.373321:0:8250:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819951488:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019089.373329:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019089.373354:0:8250:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880097579050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819951488:12345-0@lo:400:kworker/u8:2.0 Request processed in 32us (1159us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019089.373359:0:8250:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1573 00000100:00100000:0.0:1717019089.373394:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819951488:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.373549:0:2853:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819951616:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.373570:0:2853:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019089.373595:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951552 00000100:00100000:3.0:1717019089.373673:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880092968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951680:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019089.373698:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019089.373711:0:2854:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1717019089.373715:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009296d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951744:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019089.373725:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019089.373741:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951680 00000100:00100000:0.0:1717019089.373754:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819951808:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019089.373758:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951744 00000100:00100000:3.0:1717019089.373769:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1156 00000100:00100000:3.0:1717019089.373771:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951680:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019089.373775:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019089.374311:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951616 00000100:00100000:1.0:1717019089.374331:0:8253:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951808 00000100:00100000:1.0:1717019089.374339:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1717019089.374342:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a69c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819951552:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:1.0:1717019089.374353:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a69c3dc0 x1800422819951552/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:434/0 lens 224/224 e 0 to 0 dl 1717019169 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1717019089.374378:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a69c3dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1800422819951552:12345-0@lo:400:kworker/u8:2.0 Request processed in 35us (1049us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019089.374382:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 866 00000100:00100000:1.0:1717019089.374392:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1717019089.374394:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819951616:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:1.0:1717019089.374401:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013539ed40 x1800422819951616/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:434/0 lens 224/224 e 0 to 0 dl 1717019169 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1717019089.374416:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539ed40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:2853:x1800422819951616:12345-0@lo:400:kworker/u8:2.0 Request processed in 22us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019089.374420:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 867 00000100:00100000:1.0:1717019089.374428:0:8253:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1717019089.374439:0:8253:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819951808:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:1.0:1717019089.374446:0:8253:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c278000 x1800422819951808/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:434/0 lens 224/224 e 0 to 0 dl 1717019169 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1717019089.374463:0:8253:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1800422819951808:12345-0@lo:400:kworker/u8:2.0 Request processed in 24us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019089.374467:0:8253:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 868 00000100:00100000:1.0:1717019089.374492:0:2853:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2853:1800422819951616:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.374514:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2852:1800422819951808:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.374521:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2852:1800422819951552:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.374543:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1717019089.374546:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a2354740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951744:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019089.374570:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2354740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951744:12345-0@lo:400:kworker/u8:2.0 Request processed in 23us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019089.374574:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1157 00000100:00100000:1.0:1717019089.374601:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009296d580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951744:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019089.374708:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2355a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819951680:12345-0@lo:400:kworker/u8:2.0 Request processed in 935us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019089.374713:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1156 00000100:00100000:1.0:1717019089.374784:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880092968000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819951680:0@lo:400:kworker/u8:2.0 00010000:00010000:0.0:1717019089.858243:0:12712:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1717019090.860203:0:14979:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019091.862142:0:8092:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1717019092.864108:0:6620:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1717019092.892634:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1717019092.892655:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819951872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019092.892705:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1717019092.894221:0:13505:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951872 00000100:00100000:2.0:1717019092.894270:0:13505:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 640 00000100:00100000:2.0:1717019092.894275:0:13505:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c27da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819951872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1717019092.894304:0:13505:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 1703936 granted 511639552 pending 0 free 3458203648 avail 3456106496 00000100:00100000:2.0:1717019092.894365:0:13505:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c27da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819951872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019092.894371:0:13505:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 640 00000100:00100000:1.0:1717019092.894464:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819951872:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1717019093.310538:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:0.0:1717019093.310586:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019093.310607:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692224 00000100:00100000:0.0:1717019093.310624:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019093.310651:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1574 00000100:00100000:2.0:1717019093.310657:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838692224:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019093.310723:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:461e9689-0dac-4669-87c3-00abdddc539f+9:1835:x1800422838692224:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 67us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019093.310723:0:8489:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692288 00000100:00100000:2.0:1717019093.310730:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1574 00000100:00100000:1.0:1717019093.310751:0:8489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 869 00000100:00100000:1.0:1717019093.310755:0:8489:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c279300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12cff408-c572-49fa-81b0-09052c8e7f41+69:1836:x1800422838692288:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00010000:00000080:1.0:1717019093.310785:0:8489:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c279300 x1800422838692288/t0(0) o400->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:438/0 lens 224/224 e 0 to 0 dl 1717019173 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1717019093.310807:0:8489:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c279300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:12cff408-c572-49fa-81b0-09052c8e7f41+69:1836:x1800422838692288:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 51us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1717019093.310812:0:8489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 869 00000100:00100000:0.0:1717019093.310923:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019093.311012:0:14904:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692416 00000100:00100000:3.0:1717019093.311026:0:23351:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692352 00000100:00100000:2.0:1717019093.311033:0:14904:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1158 00000100:00100000:2.0:1717019093.311035:0:14904:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c27bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838692416:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1717019093.311059:0:23351:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 1159 00000100:00100000:3.0:1717019093.311063:0:23351:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c27b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1835:x1800422838692352:12345-192.168.203.26@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1717019093.311067:0:14904:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c27bdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_009:12cff408-c572-49fa-81b0-09052c8e7f41+519:1836:x1800422838692416:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 31us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019093.311072:0:14904:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1158 00000100:00100000:3.0:1717019093.311087:0:23351:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c27b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_018:12cff408-c572-49fa-81b0-09052c8e7f41+549:1835:x1800422838692352:12345-192.168.203.26@tcp:400:kworker/u8:2.0 Request processed in 24us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019093.311092:0:23351:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 1159 00000004:00080000:3.0:1717019093.566998:0:9645:0:(osp_precreate.c:1532:osp_precreate_reserve()) lustre-OST0001-osc-MDT0000: slow creates, last=[0x0:0x1:0x0], next=[0x0:0x1:0x0], reserved=0, sync_changes=0, sync_rpcs_in_progress=0, status=-11 00010000:00010000:3.0:1717019093.567110:0:9645:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567124:0:9645:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567131:0:9645:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567136:0:9645:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8801334e0480 already unused, calling callback (ffffffffa1346360) 00010000:00010000:3.0:1717019093.567140:0:9645:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567147:0:9645:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567164:0:9645:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2cfd:0x0].0x0 (ffff880132059300) 00010000:00010000:3.0:1717019093.567166:0:9645:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1717019093.567170:0:9645:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567193:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e0480/0x81e56358f42c2295 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2cfd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567251:0:9645:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2f40/0x81e56358f42c228e lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3693e expref: 68 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567258:0:9645:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8801334e2f40/0x81e56358f42c228e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2cfc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.26@tcp remote: 0xe1aedd3f13a3693e expref: 68 pid: 9645 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1717019093.567267:0:9645:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8801334e2f40, rc 0) 00010000:00000080:3.0:1717019093.567274:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a2353440 x1800422838691328/t0(0) o101->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:418/0 lens 1104/600 e 0 to 0 dl 1717019153 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:3.0:1717019093.567347:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a2353440 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:12cff408-c572-49fa-81b0-09052c8e7f41+67:28707:x1800422838691328:12345-192.168.203.26@tcp:101:lfs.0 Request processed in 20002264us (20002337us total) trans 0 rc 301/301 00000100:00100000:3.0:1717019093.567360:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 400 00000100:00100000:0.0:1717019093.568680:0:2845:0:(events.c:361:request_in_callback()) peer: 12345-192.168.203.26@tcp (source: 12345-192.168.203.26@tcp) 00000100:00100000:2.0:1717019093.568758:0:8255:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422838692544 00000100:00100000:2.0:1717019093.568798:0:8255:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.26@tcp, seq: 59 00000100:00100000:2.0:1717019093.568801:0:8255:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e5dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12cff408-c572-49fa-81b0-09052c8e7f41+67:28707:x1800422838692544:12345-192.168.203.26@tcp:35:lfs.0 00010000:00000080:2.0:1717019093.569137:0:8255:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012e5dc850 x1800422838692544/t12884902051(0) o35->12cff408-c572-49fa-81b0-09052c8e7f41@192.168.203.26@tcp:364/0 lens 392/456 e 0 to 0 dl 1717019099 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1717019093.569207:0:8255:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e5dc850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:12cff408-c572-49fa-81b0-09052c8e7f41+68:28707:x1800422838692544:12345-192.168.203.26@tcp:35:lfs.0 Request processed in 403us (529us total) trans 12884902051 rc 0/0 00000100:00100000:2.0:1717019093.569216:0:8255:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.26@tcp, seq: 59 00010000:00010000:0.0:1717019093.866043:0:12711:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1717019093.978542:0:3015:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1717019093.978546:0:3015:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_23f: @@@@@@ FAIL: Create /mnt/lustre/d23f.sanity-pfl/f23f.sanity-pfl failed 00000100:00100000:0.0:1717019094.380231:0:2855:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1717019094.380249:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819952000:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019094.380295:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019094.380325:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819951936:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019094.380335:0:2854:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013289d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819952192:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019094.380345:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019094.380358:0:2855:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013731c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819952256:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019094.380361:0:2854:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019094.380404:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819952064:0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019094.380585:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819952000 00000100:00100000:0.0:1717019094.380591:0:2855:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1717019094.380599:0:8248:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819951936 00000100:00100000:2.0:1717019094.380613:0:9645:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819952256 00000100:00100000:3.0:1717019094.380616:0:8248:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1575 00000100:00100000:0.0:1717019094.380616:0:8489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 870 00000100:00100000:3.0:1717019094.380620:0:8248:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819951936:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019094.380620:0:8489:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c278980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819952000:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019094.380625:0:9645:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 871 00000100:00100000:2.0:1717019094.380627:0:9645:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c27e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819952256:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:0.0:1717019094.380632:0:8489:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c278980 x1800422819952000/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:439/0 lens 224/224 e 0 to 0 dl 1717019174 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00010000:00000080:2.0:1717019094.380634:0:9645:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c27e3c0 x1800422819952256/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:439/0 lens 224/224 e 0 to 0 dl 1717019174 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1717019094.380653:0:8248:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009757b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:627fc11f-491c-4f89-ad31-986408f4a526+18:2855:x1800422819951936:12345-0@lo:400:kworker/u8:2.0 Request processed in 33us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1717019094.380658:0:8248:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1575 00000100:00100000:0.0:1717019094.380658:0:8489:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c278980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2855:x1800422819952000:12345-0@lo:400:kworker/u8:2.0 Request processed in 38us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019094.380659:0:9645:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c27e3c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:2855:x1800422819952256:12345-0@lo:400:kworker/u8:2.0 Request processed in 31us (69us total) trans 0 rc 0/0 00000100:00100000:2.0:1717019094.380662:0:9645:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 871 00000100:00100000:0.0:1717019094.380670:0:8489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 870 00000100:00100000:0.0:1717019094.380697:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013731c740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2855:1800422819952256:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019094.380704:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2352140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2855:1800422819952000:0@lo:400:kworker/u8:2.0 00000100:00100000:0.0:1717019094.380710:0:2855:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:627fc11f-491c-4f89-ad31-986408f4a526:2855:1800422819951936:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019094.380715:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1717019094.380727:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1717019094.380732:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819952128:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019094.380746:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1717019094.380769:0:22214:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819952192 00000100:00100000:1.0:1717019094.380772:0:14898:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819952128 00000100:00100000:0.0:1717019094.380800:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1717019094.380803:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013731b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819952192:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019094.380923:0:8489:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1800422819952064 00000100:00100000:2.0:1717019094.380939:0:8489:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 872 00000100:00100000:2.0:1717019094.380942:0:8489:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819952064:12345-0@lo:400:kworker/u8:2.0 00010000:00000080:2.0:1717019094.380949:0:8489:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88013539df00 x1800422819952064/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:439/0 lens 224/224 e 0 to 0 dl 1717019174 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:0.0:1717019094.380953:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013731b900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2854:x1800422819952192:12345-0@lo:400:kworker/u8:2.0 Request processed in 148us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019094.380958:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1160 00000100:00100000:0.0:1717019094.380967:0:22214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1161 00000100:00100000:0.0:1717019094.380970:0:22214:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013539da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819952128:12345-0@lo:400:kworker/u8:2.0 00000100:00100000:2.0:1717019094.380996:0:8489:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539df00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:2852:x1800422819952064:12345-0@lo:400:kworker/u8:2.0 Request processed in 53us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019094.381001:0:22214:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013539da40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_014:lustre-MDT0000-mdtlov_UUID+5:2852:x1800422819952128:12345-0@lo:400:kworker/u8:2.0 Request processed in 30us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1717019094.381005:0:22214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1161 00000100:00100000:2.0:1717019094.381012:0:8489:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 872 00000100:00100000:1.0:1717019094.381176:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a2356d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2852:1800422819952128:0@lo:400:kworker/u8:2.0 00000100:00100000:1.0:1717019094.381183:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a23517c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2852:1800422819952064:0@lo:400:kworker/u8:2.0 00000100:00100000:3.0:1717019094.381227:0:2854:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013289d0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2854:1800422819952192:0@lo:400:kworker/u8:2.0 Debug log: 2478 lines, 2478 kept, 0 dropped, 0 bad.