00010000:00010000:1.0F:1721219350.145724:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0F:1721219350.317692:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219350.317755:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219350.317768:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511264704 00000100:00100000:3.0:1721219350.317785:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219350.317819:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 649 00000100:00100000:3.0:1721219350.317822:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219350.317826:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7ac280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:1837:x1804827511264704:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00010000:00000080:1.0:1721219350.317860:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88009c7ac280 x1804827511264704/t0(0) o400->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:640/0 lens 224/224 e 0 to 0 dl 1721219440 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1721219350.317868:0:14647:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511264832 00000100:00100000:0.0F:1721219350.317874:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511264768 00000100:00100000:2.0F:1721219350.317876:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511264640 00000100:00100000:3.0:1721219350.317897:0:14647:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 900 00000100:00100000:3.0:1721219350.317903:0:14647:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae52600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1837:x1804827511264832:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219350.317919:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 901 00000100:00100000:1.0:1721219350.317920:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7ac280 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:1837:x1804827511264704:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 95us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219350.317924:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 946 00000100:00100000:0.0:1721219350.317924:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae54c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511264768:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219350.317929:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 649 00000100:00100000:2.0:1721219350.317931:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1836:x1804827511264640:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219350.317941:0:14647:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae52600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1837:x1804827511264832:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 38us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219350.317948:0:14647:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 900 00000100:00100000:2.0:1721219350.317973:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1836:x1804827511264640:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 42us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219350.317980:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 946 00000100:00100000:0.0:1721219350.317995:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae54c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511264768:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 70us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.318003:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 901 00000001:00080000:3.0:1721219350.476707:0:27193:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902030 is committed 00000020:00000080:3.0:1721219350.522066:0:14024:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1721219350.522074:0:14024:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1721219350.522078:0:14024:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1721219350.522661:0:14024:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:3.0:1721219350.522670:0:14024:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:3.0:1721219350.522708:0:14024:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_22c.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1721219350.523418:0:14025:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 99 marker 65 1->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0000_UUID 20000000:01000000:3.0:1721219350.523621:0:14025:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 101 marker 65 2->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:3.0:1721219350.523726:0:14025:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 105 count 103 00000040:00080000:0.0:1721219350.524117:0:14024:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].105, 224 off27712 20000000:01000000:0.0:1721219350.524133:0:14024:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_22c lustre-OST0000_UUID (null) 00000040:00080000:0.0:1721219350.524176:0:14024:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].106, 144 off27856 00000040:00080000:0.0:1721219350.524219:0:14024:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].107, 224 off28080 20000000:01000000:0.0:1721219350.524618:0:14024:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_22c.lustre-OST0000_UUID fl=4 20000000:01000000:1.0:1721219350.525385:0:14026:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 103 marker 66 1->4: lustre-clilov add lustre.test_22c.lustre-OST0000_UUID 20000000:01000000:1.0:1721219350.525453:0:14026:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 105 marker 66 2->4: lustre-clilov add lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:1.0:1721219350.525571:0:14026:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 109 count 108 00000040:00080000:0.0:1721219350.525823:0:14024:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].109, 224 off28032 20000000:01000000:0.0:1721219350.525833:0:14024:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce022 lustre test_22c lustre-OST0000_UUID (null) 00000040:00080000:0.0:1721219350.525900:0:14024:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].110, 136 off28168 00000040:00080000:0.0:1721219350.525944:0:14024:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].111, 224 off28392 10000000:01000000:0.0:1721219350.525956:0:14024:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1721219350.525975:0:14024:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.525996:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526003:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526010:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001811 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526017:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00181f expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526032:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00182d expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526037:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00183b expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526042:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001849 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526047:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001857 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526052:0:14024:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001865 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526058:0:14024:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526099:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001865 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526112:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001865 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.526126:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee904c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585472:0@lo:104: 00000100:00100000:0.0:1721219350.526193:0:14024:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219350.526231:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001857 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526237:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001857 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.526253:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585536:0@lo:104: 00010000:00010000:0.0:1721219350.526274:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001849 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526280:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001849 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.526287:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee93440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585600:0@lo:104: 00010000:00010000:0.0:1721219350.526301:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e00183b expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526306:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e00183b expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.526312:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee963c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585664:0@lo:104: 00000100:00100000:1.0:1721219350.526313:0:20782:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:0.0:1721219350.526326:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e00182d expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526331:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e00182d expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.526337:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee92f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585728:0@lo:104: 00000100:00100000:1.0:1721219350.526356:0:20782:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219350.526390:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585472 00000100:00100000:1.0:1721219350.526406:0:20782:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219350.526426:0:20782:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219350.526447:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585536 00000100:00100000:1.0:1721219350.526452:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585600 00000100:00100000:0.0:1721219350.526458:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585664 00000100:00100000:0.0:1721219350.526509:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1721219350.526516:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880133b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14024:x1804827459585472:12345-0@lo:104: 00000100:00100000:1.0:1721219350.526524:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1721219350.526530:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f60e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14024:x1804827459585536:12345-0@lo:104: 00000100:00100000:3.0:1721219350.526540:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1721219350.526548:0:14024:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219350.526549:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f62ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14024:x1804827459585664:12345-0@lo:104: 00010000:00010000:0.0:1721219350.526564:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1721219350.526573:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880133b5a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14024:x1804827459585472:12345-0@lo:104: Request processed in 58us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.526581:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00010000:00010000:2.0:1721219350.526627:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e00181f expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526627:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1721219350.526634:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f60e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14024:x1804827459585536:12345-0@lo:104: Request processed in 103us (280us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219350.526638:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1721219350.526642:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1721219350.526644:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f62ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14024:x1804827459585664:12345-0@lo:104: Request processed in 96us (217us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219350.526645:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e00181f expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.526645:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585728 00000100:00100000:3.0:1721219350.526651:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1721219350.526659:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6b900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585792:0@lo:104: 00000100:00100000:0.0:1721219350.526660:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1721219350.526665:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1721219350.526666:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f62600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14024:x1804827459585600:12345-0@lo:104: 00000100:00100000:1.0:1721219350.526670:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf68e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14024:x1804827459585728:12345-0@lo:104: 00010000:00010000:3.0:1721219350.526702:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1721219350.526707:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219350.526710:0:14024:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219350.526716:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1721219350.526719:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1721219350.526720:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f62600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14024:x1804827459585600:12345-0@lo:104: Request processed in 55us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219350.526724:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf68e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14024:x1804827459585728:12345-0@lo:104: Request processed in 54us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.526726:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00010000:00010000:3.0:1721219350.526731:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5200 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:2.0:1721219350.526733:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001811 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219350.526734:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219350.526740:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1721219350.526740:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585792 00010000:00010000:3.0:1721219350.526741:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219350.526741:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001811 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 10000000:00010000:3.0:1721219350.526747:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219350.526748:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585856:0@lo:104: 10000000:01000000:3.0:1721219350.526753:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1721219350.526755:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1721219350.526759:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf6c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14024:x1804827459585792:12345-0@lo:104: 00000100:00100000:2.0:1721219350.526764:0:14024:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219350.526767:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1721219350.526773:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526781:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e4fc0 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219350.526784:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526786:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1721219350.526789:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf6c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14024:x1804827459585792:12345-0@lo:104: Request processed in 30us (80us total) trans 0 rc 0/0 00010000:00010000:0.0:1721219350.526791:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526794:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219350.526795:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 10000000:00010000:0.0:1721219350.526797:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526800:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219350.526802:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219350.526803:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1721219350.526804:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585856 00010000:00010000:2.0:1721219350.526810:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 8 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:1.0:1721219350.526815:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00010000:00010000:3.0:1721219350.526816:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219350.526818:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf697c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14024:x1804827459585856:12345-0@lo:104: 00000100:00100000:2.0:1721219350.526822:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6b440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585984:192.168.201.58@tcp:104: 00010000:00010000:3.0:1721219350.526823:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001865 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00186c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526834:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1721219350.526835:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526836:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526838:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:3.0:1721219350.526841:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e61c0 already unused, calling callback (ffffffffa0aca5c0) 00000100:00100000:1.0:1721219350.526841:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf697c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14024:x1804827459585856:12345-0@lo:104: Request processed in 22us (78us total) trans 0 rc 0/0 00010000:00010000:0.0:1721219350.526841:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1721219350.526843:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219350.526846:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00010000:00010000:3.0:1721219350.526848:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526850:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526860:0:9965:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1721219350.526860:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001857 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00185e expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219350.526863:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526864:0:9965:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219350.526868:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219350.526872:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1721219350.526873:0:14024:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526874:0:9965:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e4000 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:0.0:1721219350.526874:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219350.526876:0:9965:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526880:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6640 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219350.526882:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526885:0:9965:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526888:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219350.526891:0:9965:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526892:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219350.526893:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219350.526894:0:14024:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 8 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:3.0:1721219350.526898:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1721219350.526898:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1721219350.526902:0:14024:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6d0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459586112:192.168.201.58@tcp:104: 10000000:01000000:1.0:1721219350.526907:0:9965:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219350.526908:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526912:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526914:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e61c0/0xd4836d281e00183b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001842 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526916:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1721219350.526920:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721219350.526922:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526923:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219350.526925:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526927:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e6640/0xd4836d281e00182d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001834 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526930:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0cb40 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219350.526932:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219350.526932:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459586240:0@lo:103:ldlm_bl_02.0 00010000:00010000:0.0:1721219350.526936:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219350.526937:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526938:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526938:0:9965:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219350.526943:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526944:0:9965:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1721219350.526947:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219350.526950:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a5451f80 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:1.0:1721219350.526951:0:9965:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219350.526952:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.526956:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219350.526957:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219350.526957:0:9965:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e4000/0xd4836d281e001849 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001850 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219350.526958:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219350.526963:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219350.526967:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1721219350.526968:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219350.526969:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219350.526970:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219350.526971:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219350.526972:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459586176:0@lo:103:ldlm_bl_04.0 00010000:00010000:3.0:1721219350.526975:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526976:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219350.526979:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00181f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001826 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.526980:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219350.526981:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219350.526984:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219350.526987:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219350.526988:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219350.526989:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219350.526991:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219350.526993:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219350.526996:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1721219350.526998:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a5451f80/0xd4836d281e001811 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001818 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219350.527003:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae53900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459585920:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1721219350.527005:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee91c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459586432:0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219350.527006:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459586048:0@lo:103:ldlm_bl_02.0 00010000:00010000:0.0:1721219350.527011:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219350.527012:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219350.527014:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219350.527022:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219350.527041:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219350.527045:0:6717:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586240 00000100:00100000:2.0:1721219350.527053:0:15871:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586176 00000100:00100000:1.0:1721219350.527059:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459586304:0@lo:103:ldlm_bl_05.0 00010000:00010000:0.0:1721219350.527062:0:6717:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00182d expref: 19 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:3.0:1721219350.527063:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586432 00010000:00010000:2.0:1721219350.527069:0:15871:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00183b expref: 20 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:1.0:1721219350.527075:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219350.527078:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001811 expref: 20 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.527085:0:6717:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459585920 00010000:00010000:0.0:1721219350.527094:0:6717:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001865 expref: 21 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:2.0:1721219350.527104:0:15871:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586304 00010000:00010000:2.0:1721219350.527113:0:15871:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001849 expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:1.0:1721219350.527115:0:13966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179000 00000100:00100000:1.0:1721219350.527120:0:13966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf6d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2852:x1804827459586240:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219350.527122:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179001 00000100:00100000:3.0:1721219350.527128:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf6aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2852:x1804827459586176:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219350.527130:0:13966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721219350.527135:0:15871:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179002 00010000:00010000:1.0:1721219350.527136:0:13966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00182d expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:3.0:1721219350.527141:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721219350.527141:0:15871:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6678050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2852:x1804827459586432:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:0.0:1721219350.527142:0:6717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179003 00010000:00010000:3.0:1721219350.527146:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00183b expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.527146:0:13966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e00182d expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.527148:0:6717:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f67200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2849:x1804827459585920:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:2.0:1721219350.527150:0:15871:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721219350.527153:0:15871:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001811 expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:0.0:1721219350.527158:0:6717:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219350.527161:0:6717:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001865 expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:3.0:1721219350.527167:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e00183b expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:2.0:1721219350.527182:0:15871:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001811 expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:0.0:1721219350.527206:0:6717:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001865 expref: 22 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.527226:0:13966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721219350.527234:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219350.527235:0:15871:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721219350.527237:0:6717:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219350.527266:0:13966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf6d580 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2852:x1804827459586240:12345-0@lo:103:ldlm_bl_02.0 Request processed in 146us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219350.527273:0:13966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179000 00000100:00100000:1.0:1721219350.527290:0:13966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179004 00000100:00100000:2.0:1721219350.527293:0:15871:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6678050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2852:x1804827459586432:12345-0@lo:103:ldlm_bl_02.0 Request processed in 152us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219350.527294:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf6aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2852:x1804827459586176:12345-0@lo:103:ldlm_bl_04.0 Request processed in 163us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219350.527294:0:13966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f60980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2849:x1804827459586304:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1721219350.527295:0:6717:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f67200 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2849:x1804827459585920:12345-0@lo:103:ldlm_bl_04.0 Request processed in 147us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219350.527301:0:15871:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179002 00010000:00010000:1.0:1721219350.527301:0:13966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219350.527304:0:13966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001849 expref: 21 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.527307:0:6717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179003 00000100:00100000:3.0:1721219350.527312:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179001 00010000:00010000:1.0:1721219350.527312:0:13966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001849 expref: 20 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.527320:0:13966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219350.527339:0:13966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f60980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2849:x1804827459586304:12345-0@lo:103:ldlm_bl_05.0 Request processed in 45us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219350.527344:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee91c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459586432:0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219350.527345:0:13966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179004 00000100:00100000:2.0:1721219350.527352:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459586240:0@lo:103:ldlm_bl_02.0 00000100:00100000:2.0:1721219350.527359:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459586176:0@lo:103:ldlm_bl_04.0 00000100:00100000:1.0:1721219350.527383:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae53900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459585920:0@lo:103:ldlm_bl_04.0 00000100:00100000:3.0:1721219350.527388:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219350.527391:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f63dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459586304:0@lo:103:ldlm_bl_05.0 00000100:00100000:2.0:1721219350.527407:0:14024:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b2795600 going to sleep for 6 seconds 00010000:00010000:2.0:1721219350.527419:0:14024:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0c6c0/0xd4836d281e00186c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001865 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.527427:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586048 00000100:00100000:3.0:1721219350.527428:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459586368:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1721219350.527429:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee904c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585472:0@lo:104: 00000100:00100000:2.0:1721219350.527436:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585536:0@lo:104: 00010000:00010000:0.0:1721219350.527440:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001857 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:2.0:1721219350.527444:0:14024:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0c240/0xd4836d281e001850 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001849 expref: 17 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:2.0:1721219350.527451:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee93440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585600:0@lo:104: 00010000:00010000:2.0:1721219350.527457:0:14024:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0cfc0/0xd4836d281e001842 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e00183b expref: 16 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.527459:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179005 00000100:00100000:3.0:1721219350.527462:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219350.527464:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee963c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585664:0@lo:104: 00000100:00100000:0.0:1721219350.527464:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae50980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:2850:x1804827459586048:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:0.0:1721219350.527492:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219350.527495:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001857 expref: 15 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:2.0:1721219350.527502:0:14024:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0d200/0xd4836d281e001834 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e00182d expref: 15 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:0.0:1721219350.527504:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001857 expref: 15 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:2.0:1721219350.527510:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee92f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585728:0@lo:104: 00010000:00010000:0.0:1721219350.527514:0:8342:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0dd40/0xd4836d281e00185e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001857 expref: 14 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:2.0:1721219350.527517:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6b900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585792:0@lo:104: 00010000:00010000:0.0:1721219350.527533:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219350.527534:0:14024:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e001818 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001811 expref: 13 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:2.0:1721219350.527543:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585856:0@lo:104: 00000100:00100000:0.0:1721219350.527561:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae50980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:2850:x1804827459586048:12345-0@lo:103:ldlm_bl_02.0 Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.527567:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179005 00000100:00100000:1.0:1721219350.527577:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586368 00000100:00100000:3.0:1721219350.527612:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459586048:0@lo:103:ldlm_bl_02.0 00010000:00010000:1.0:1721219350.527613:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00181f expref: 12 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:1.0:1721219350.527634:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179006 00000100:00100000:1.0:1721219350.527638:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:2850:x1804827459586368:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219350.527645:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219350.527655:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00181f expref: 12 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.527663:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e00181f expref: 12 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.527673:0:25696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001826 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e00181f expref: 12 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.527683:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219350.527723:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:2850:x1804827459586368:12345-0@lo:103:ldlm_bl_04.0 Request processed in 85us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219350.527731:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179006 00000100:00100000:3.0:1721219350.527789:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459586368:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1721219350.528186:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6b440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459585984:192.168.201.58@tcp:104: 00000100:00100000:2.0:1721219350.528198:0:14024:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6d0c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14024:1804827459586112:192.168.201.58@tcp:104: 00000100:00100000:0.0:1721219350.528203:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219350.528232:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:2.0:1721219350.528241:0:14024:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219350.528247:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511264896 00010000:00010000:0.0:1721219350.528260:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 9 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.528282:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511264960 00010000:00010000:0.0:1721219350.528290:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 10 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.528305:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179007 00000100:00100000:0.0:1721219350.528310:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1834:x1804827511264896:12345-192.168.201.58@tcp:103:ldlm_bl_01.0 00010000:00010000:0.0:1721219350.528317:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219350.528320:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 10 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:1.0:1721219350.528328:0:6719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179008 00010000:00010000:0.0:1721219350.528328:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 10 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:1.0:1721219350.528337:0:6719:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee94740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511264960:12345-192.168.201.58@tcp:103:ldlm_bl_02.0 00010000:00010000:0.0:1721219350.528338:0:8342:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e00180a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ad0 expref: 10 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:0.0:1721219350.528347:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219350.528351:0:6719:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219350.528359:0:6719:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 9 pid: 27116 timeout: 1896 lvb_type: 0 00010000:00010000:1.0:1721219350.528372:0:6719:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 9 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.528384:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1834:x1804827511264896:12345-192.168.201.58@tcp:103:ldlm_bl_01.0 Request processed in 74us (183us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219350.528386:0:6719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001803 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72ac9 expref: 9 pid: 27116 timeout: 1896 lvb_type: 0 00000100:00100000:0.0:1721219350.528398:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179007 00010000:00010000:1.0:1721219350.528400:0:6719:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528407:0:6719:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528419:0:6719:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528434:0:6719:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528440:0:6719:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528445:0:6719:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528450:0:6719:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0f840 already unused, calling callback (ffffffffa0815190) 00010000:00010000:1.0:1721219350.528453:0:6719:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528459:0:6719:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528531:0:6719:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.528540:0:14024:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219350.528544:0:6719:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721219350.528555:0:14024:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219350.528564:0:14024:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0f840/0xd4836d281e0018d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14024 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219350.528616:0:6719:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee94740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:1835:x1804827511264960:12345-192.168.201.58@tcp:103:ldlm_bl_02.0 Request processed in 254us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219350.528625:0:6719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179008 00000100:00100000:0.0:1721219350.835727:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2849:1804827459586560:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219350.835729:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee92600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459586496:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721219350.835770:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae51c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459586688:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219350.835791:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2850:1804827459586624:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219350.835822:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219350.835822:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219350.835835:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219350.835860:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219350.835870:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae56d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459586752:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219350.835876:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae53440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2849:1804827459586816:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219350.835889:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219350.835902:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219350.835917:0:27124:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586560 00000100:00100000:1.0:1721219350.835917:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586624 00000100:00100000:2.0:1721219350.835923:0:23317:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586496 00000100:00100000:0.0:1721219350.835942:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586688 00000100:00100000:2.0:1721219350.835952:0:23317:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00000100:00100000:1.0:1721219350.835957:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586816 00000100:00100000:2.0:1721219350.835958:0:23317:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf6d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2852:x1804827459586496:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721219350.835969:0:27124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 650 00000100:00100000:3.0:1721219350.835976:0:27124:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae55f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2850:x1804827459586624:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219350.835979:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586752 00000100:00100000:1.0:1721219350.835987:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 651 00002000:00000024:2.0:1721219350.835991:0:23317:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 511770624 pending 0 free 3458203648 avail 3456106496 00000100:00100000:1.0:1721219350.835993:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee96880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2849:x1804827459586560:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:3.0:1721219350.835998:0:27124:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ae55f00 x1804827459586624/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:640/0 lens 224/224 e 0 to 0 dl 1721219440 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1721219350.835999:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 902 00000100:00100000:0.0:1721219350.836004:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f63dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:2851:x1804827459586688:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:1.0:1721219350.836013:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee96880 x1804827459586560/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:640/0 lens 224/224 e 0 to 0 dl 1721219440 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:2.0:1721219350.836027:0:23317:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf6d0c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2852:x1804827459586496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219350.836033:0:23317:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:3.0:1721219350.836049:0:27124:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae55f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2850:x1804827459586624:12345-0@lo:400:kworker/u8:1.0 Request processed in 73us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219350.836058:0:27124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 650 00000100:00100000:0.0:1721219350.836059:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f63dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459586688:12345-0@lo:400:kworker/u8:1.0 Request processed in 55us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.836066:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 902 00000100:00100000:2.0:1721219350.836077:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee92600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459586496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721219350.836078:0:27124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 652 00000100:00100000:1.0:1721219350.836081:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee96880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2849:x1804827459586560:12345-0@lo:400:kworker/u8:1.0 Request processed in 86us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.836082:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 903 00000100:00100000:3.0:1721219350.836084:0:27124:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee950c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2849:x1804827459586816:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219350.836086:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf6b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2852:x1804827459586752:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219350.836092:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 651 00010000:00000080:3.0:1721219350.836098:0:27124:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee950c0 x1804827459586816/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:640/0 lens 224/224 e 0 to 0 dl 1721219440 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1721219350.836119:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf6b440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2852:x1804827459586752:12345-0@lo:400:kworker/u8:1.0 Request processed in 32us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219350.836125:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 903 00000100:00100000:2.0:1721219350.836129:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae56d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459586752:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219350.836149:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae51c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459586688:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219350.836151:0:27124:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee950c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2849:x1804827459586816:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219350.836160:0:27124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 652 00000100:00100000:0.0:1721219350.836169:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae53440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2849:1804827459586816:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219350.836181:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2849:1804827459586560:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219350.836202:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2850:1804827459586624:0@lo:400:kworker/u8:1.0 00010000:00010000:1.0:1721219351.147820:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1721219351.947614:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219351.947621:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a6512800 from 109 10000000:01000000:2.0:1721219351.947627:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219351.947667:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.947689:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.947701:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.947725:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459586880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.947789:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.947827:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.947901:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586880 00000100:00100000:0.0:1721219351.947984:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 947 00000100:00100000:0.0:1721219351.947993:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:6729:x1804827459586880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.948016:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219351.948058:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0018dc expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.948095:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0018dc expref: 12 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.948110:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0018dc expref: 12 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.948124:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0f840, rc 0) 00000100:00100000:0.0:1721219351.948224:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459586880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 230us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.948235:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 947 00000100:00100000:2.0:1721219351.948327:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459586880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.948349:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.948360:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.948423:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459586944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.948455:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.948517:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.948530:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459586944 00000100:00100000:0.0:1721219351.948593:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 948 00000100:00100000:0.0:1721219351.948600:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459586944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.948809:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459586944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.948819:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 948 00000100:00100000:2.0:1721219351.948846:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459586944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.948878:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.948998:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.949023:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.949068:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587008 00000100:00100000:0.0:1721219351.949107:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 949 00000100:00100000:0.0:1721219351.949113:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459587008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.949406:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459587008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.949417:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 949 00000100:00100000:2.0:1721219351.949524:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219351.950025:0:14028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14028:1804827459587072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.950084:0:14028:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.950116:0:14028:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.950158:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587072 00000100:00100000:0.0:1721219351.950188:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 950 00000100:00100000:0.0:1721219351.950194:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14028:x1804827459587072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.950712:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14028:x1804827459587072:12345-0@lo:502:llog_process_th.0 Request processed in 517us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.950723:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 950 00000100:00100000:3.0:1721219351.950786:0:14028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14028:1804827459587072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.950847:0:14028:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14028:1804827459587136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.950889:0:14028:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.950922:0:14028:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.950962:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587136 00000100:00100000:0.0:1721219351.951003:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 951 00000100:00100000:0.0:1721219351.951009:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14028:x1804827459587136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.951251:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14028:x1804827459587136:12345-0@lo:502:llog_process_th.0 Request processed in 241us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.951262:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 951 00000100:00100000:3.0:1721219351.951279:0:14028:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14028:1804827459587136:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1721219351.951309:0:14028:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 112 count 111 00000020:01000000:2.0:1721219351.951442:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 109-111 (rc=0) 10000000:01000000:2.0:1721219351.951511:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219351.951517:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.951527:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219351.951536:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1721219351.951538:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 105 10000000:01000000:2.0:1721219351.951541:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1721219351.951558:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.951586:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.951594:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.951609:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.951645:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.951677:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.951713:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587200 00000100:00100000:0.0:1721219351.951753:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 952 00000100:00100000:0.0:1721219351.951759:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459587200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.951769:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219351.951779:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0018ea expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.951799:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0018ea expref: 13 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.951810:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0018ea expref: 13 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.951819:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0cb40, rc 0) 00000100:00100000:0.0:1721219351.951873:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459587200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.951882:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 952 00000100:00100000:2.0:1721219351.951910:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.951924:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.951931:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.951972:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.952011:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.952025:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.952041:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587264 00000100:00100000:0.0:1721219351.952089:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 953 00000100:00100000:0.0:1721219351.952095:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459587264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.952206:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459587264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.952217:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 953 00000100:00100000:2.0:1721219351.952241:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.952270:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.952309:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.952321:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc300 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.952333:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587328 00000100:00100000:0.0:1721219351.952368:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 954 00000100:00100000:0.0:1721219351.952373:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459587328:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.952700:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459587328:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.952711:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 954 00000100:00100000:2.0:1721219351.952762:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587328:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219351.953060:0:14029:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14029:1804827459587392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.953131:0:14029:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.953170:0:14029:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.953202:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587392 00000100:00100000:0.0:1721219351.953229:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 955 00000100:00100000:0.0:1721219351.953234:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14029:x1804827459587392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.953687:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14029:x1804827459587392:12345-0@lo:502:llog_process_th.0 Request processed in 451us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.953698:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 955 00000100:00100000:3.0:1721219351.953739:0:14029:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14029:1804827459587392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1721219351.953771:0:14029:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1721219351.953779:0:14029:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1721219351.953781:0:14029:0:(obd_config.c:1460:class_process_config()) marker 69 (0x1) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0000_UUID 00000020:00000080:3.0:1721219351.953786:0:14029:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1721219351.953799:0:14029:0:(lod_pool.c:669:lod_pool_remove()) lustre-OST0000_UUID removed from test_22c 00000020:01000004:3.0:1721219351.954047:0:14030:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff8800a6512800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1721219351.954050:0:14030:0:(obd_mount.c:668:lustre_put_lsi()) put ffff8800a6512800 4 00000100:00100000:0.0:1721219351.954119:0:14029:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee90980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14029:1804827459587456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.954169:0:14029:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219351.954198:0:14029:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62fdcc0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219351.954300:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587456 00000100:00100000:2.0:1721219351.954352:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 956 00000100:00100000:2.0:1721219351.954358:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14029:x1804827459587456:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219351.954717:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14029:x1804827459587456:12345-0@lo:502:llog_process_th.0 Request processed in 357us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219351.954727:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 956 00000100:00100000:0.0:1721219351.954746:0:14029:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee90980 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14029:1804827459587456:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1721219351.954783:0:14029:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1721219351.954790:0:14029:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1721219351.954793:0:14029:0:(obd_config.c:1460:class_process_config()) marker 69 (0x2) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0000_UUID 00000040:00080000:0.0:1721219351.954798:0:14029:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 108 count 106 00000020:01000000:2.0:1721219351.954845:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 105-107 (rc=0) 10000000:01000000:2.0:1721219351.954865:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1721219351.954869:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.954878:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219351.954887:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219351.954889:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880136319800 from 109 10000000:01000000:2.0:1721219351.954891:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219351.954908:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.954925:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.954933:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.954947:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.954977:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.954990:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.955009:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587520 00000100:00100000:0.0:1721219351.955035:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 957 00000100:00100000:0.0:1721219351.955041:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459587520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.955050:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219351.955060:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0018f8 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.955078:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 14 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.955088:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 14 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.955098:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0cd80, rc 0) 00000100:00100000:0.0:1721219351.955148:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459587520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.955157:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 957 00000100:00100000:2.0:1721219351.955188:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.955201:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.955208:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.955250:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.955275:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.955287:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.955302:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587584 00000100:00100000:0.0:1721219351.955333:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 958 00000100:00100000:0.0:1721219351.955339:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459587584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.955439:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459587584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.955448:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 958 00000100:00100000:2.0:1721219351.955500:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.955528:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.955596:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.955608:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.955624:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587648 00000100:00100000:0.0:1721219351.955658:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 959 00000100:00100000:0.0:1721219351.955663:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459587648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.955864:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459587648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 199us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.955886:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 959 00000100:00100000:2.0:1721219351.955891:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219351.956256:0:14031:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14031:1804827459587712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.956314:0:14031:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.956342:0:14031:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.956384:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587712 00000100:00100000:0.0:1721219351.956411:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 960 00000100:00100000:0.0:1721219351.956416:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14031:x1804827459587712:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.956795:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14031:x1804827459587712:12345-0@lo:502:llog_process_th.0 Request processed in 377us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.956805:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 960 00000100:00100000:3.0:1721219351.956900:0:14031:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14031:1804827459587712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.956956:0:14031:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14031:1804827459587776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.956999:0:14031:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.957032:0:14031:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.957064:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587776 00000100:00100000:0.0:1721219351.957100:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 961 00000100:00100000:0.0:1721219351.957106:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14031:x1804827459587776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.957316:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14031:x1804827459587776:12345-0@lo:502:llog_process_th.0 Request processed in 209us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.957325:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 961 00000100:00100000:3.0:1721219351.957349:0:14031:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14031:1804827459587776:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1721219351.957378:0:14031:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 112 count 111 00000020:01000000:2.0:1721219351.957504:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 109-111 (rc=0) 10000000:01000000:2.0:1721219351.957538:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219351.957543:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.957553:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219351.957562:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1721219351.957584:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:2.0:1721219351.957587:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1721219351.957605:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.957611:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.957618:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.957632:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.957668:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.957699:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.957736:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587840 00000100:00100000:0.0:1721219351.957771:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 962 00000100:00100000:0.0:1721219351.957776:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459587840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.957785:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219351.957794:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001906 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.957809:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001906 expref: 15 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.957819:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001906 expref: 15 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.957828:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0db00, rc 0) 00000100:00100000:0.0:1721219351.957882:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459587840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.957890:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 962 00000100:00100000:2.0:1721219351.957922:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.957935:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.957943:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.957982:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.958023:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.958051:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.958077:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587904 00000100:00100000:0.0:1721219351.958111:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 963 00000100:00100000:0.0:1721219351.958116:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459587904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.958210:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459587904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.958218:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 963 00000100:00100000:2.0:1721219351.958238:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.958264:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.958302:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.958315:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.958321:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459587968 00000100:00100000:0.0:1721219351.958351:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 964 00000100:00100000:0.0:1721219351.958356:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459587968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.958637:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459587968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 279us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.958646:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 964 00000100:00100000:2.0:1721219351.958653:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459587968:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1721219351.959592:0:14032:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1721219351.959652:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1721219351.959674:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1721219351.959677:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.959684:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219351.959693:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219351.959694:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009928e000 from 109 10000000:01000000:2.0:1721219351.959696:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219351.959710:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.959716:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.959722:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.959734:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.959772:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.959798:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.959841:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588032 00000100:00100000:0.0:1721219351.959877:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 965 00000100:00100000:0.0:1721219351.959882:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459588032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219351.959890:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219351.959899:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001914 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.959914:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001914 expref: 16 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.959923:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001914 expref: 16 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219351.959945:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0c000, rc 0) 00000100:00100000:0.0:1721219351.959993:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459588032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.960002:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 965 00000100:00100000:2.0:1721219351.960026:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.960038:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.960044:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.960081:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.960106:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.960130:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.960165:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588096 00000100:00100000:0.0:1721219351.960199:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 966 00000100:00100000:0.0:1721219351.960203:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459588096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.960294:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459588096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.960303:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 966 00000100:00100000:2.0:1721219351.960325:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.960350:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.960394:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.960419:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.960447:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588160 00000100:00100000:0.0:1721219351.960502:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 967 00000100:00100000:0.0:1721219351.960509:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459588160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219351.960722:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459588160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.960731:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 967 00000100:00100000:2.0:1721219351.960758:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219351.960994:0:14033:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14033:1804827459588224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.961050:0:14033:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.961078:0:14033:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219351.961112:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588224 00000100:00100000:0.0:1721219351.961136:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 968 00000100:00100000:0.0:1721219351.961141:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14033:x1804827459588224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219351.961424:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14033:x1804827459588224:12345-0@lo:502:llog_process_th.0 Request processed in 282us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219351.961433:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 968 00000100:00100000:3.0:1721219351.961461:0:14033:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14033:1804827459588224:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.961533:0:14033:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14033:1804827459588288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219351.961598:0:14033:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219351.961622:0:14033:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b900 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.961685:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588288 00000100:00100000:1.0:1721219351.961722:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 969 00000100:00100000:1.0:1721219351.961729:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14033:x1804827459588288:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219351.962091:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14033:x1804827459588288:12345-0@lo:502:llog_process_th.0 Request processed in 360us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219351.962103:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 969 00000100:00100000:3.0:1721219351.962111:0:14033:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14033:1804827459588288:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1721219351.962138:0:14033:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 112 count 111 00000020:01000000:2.0:1721219351.962260:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 109-111 (rc=0) 10000000:01000000:2.0:1721219351.962286:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219351.962290:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.962300:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219351.962309:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1721219351.962311:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1721219351.962323:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1721219351.962340:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.962347:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.962354:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.962368:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.962402:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.962434:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.962523:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588352 00000100:00100000:1.0:1721219351.962596:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 970 00000100:00100000:1.0:1721219351.962603:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459588352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219351.962616:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219351.962633:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001922 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219351.962657:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001922 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219351.962670:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001922 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219351.962682:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd221c0, rc 0) 00000100:00100000:1.0:1721219351.962743:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459588352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219351.962769:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 970 00000100:00100000:2.0:1721219351.962780:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.962792:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.962800:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.962839:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.962864:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.962889:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.962930:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588416 00000100:00100000:1.0:1721219351.962974:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 971 00000100:00100000:1.0:1721219351.962981:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459588416:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219351.963126:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459588416:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 143us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219351.963138:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 971 00000100:00100000:2.0:1721219351.963150:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588416:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.963175:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.963213:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.963224:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.963240:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588480 00000100:00100000:1.0:1721219351.963280:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 972 00000100:00100000:1.0:1721219351.963288:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459588480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219351.963607:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459588480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 317us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219351.963619:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 972 00000100:00100000:2.0:1721219351.963621:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1721219351.964391:0:14034:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:2.0:1721219351.964539:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1721219351.964593:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1721219351.964607:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.964618:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219351.964627:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219351.964629:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6c10000 from 1 10000000:01000000:2.0:1721219351.964631:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219351.964649:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.964655:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.964662:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.964676:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.964711:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.964737:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.964795:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588544 00000100:00100000:1.0:1721219351.964844:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 973 00000100:00100000:1.0:1721219351.964851:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459588544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219351.964862:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219351.964873:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001930 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219351.964895:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001930 expref: 18 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219351.964907:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001930 expref: 18 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219351.964917:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd20000, rc 0) 00000100:00100000:1.0:1721219351.964986:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459588544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219351.964997:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 973 00000100:00100000:2.0:1721219351.965020:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219351.965033:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.965041:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219351.965104:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219351.965132:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219351.965158:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc540 going to sleep for 6 seconds 00000100:00100000:1.0:1721219351.965200:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588608 00000100:00100000:1.0:1721219351.965242:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 974 00000100:00100000:1.0:1721219351.965248:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459588608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219351.965353:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459588608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (218us total) trans 0 rc -2/-2 00000100:00100000:1.0:1721219351.965364:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 974 00000100:00100000:2.0:1721219351.965378:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459588608:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1721219351.965403:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1721219351.965407:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219351.965413:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.149674:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219352.445717:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.445824:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265024 00000100:00100000:1.0:1721219352.445894:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 975 00000100:00100000:1.0:1721219352.445904:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:4616:x1804827511265024:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219352.445922:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219352.445941:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72af3 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.445974:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.445989:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.446000:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd23180, rc 0) 00000100:00100000:1.0:1721219352.446080:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265024:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 176us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.446093:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 975 00000100:00100000:0.0:1721219352.447086:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.447215:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265088 00000100:00100000:1.0:1721219352.447274:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 976 00000100:00100000:1.0:1721219352.447281:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265088:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219352.447422:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265088:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 140us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.447431:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 976 00000100:00100000:2.0:1721219352.448399:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.448529:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265152 00000100:00100000:1.0:1721219352.448613:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 977 00000100:00100000:1.0:1721219352.448623:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265152:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219352.448906:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265152:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 282us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.448916:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 977 00000100:00100000:0.0:1721219352.449944:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.450067:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265216 00000100:00100000:1.0:1721219352.450111:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 978 00000100:00100000:1.0:1721219352.450117:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22817:x1804827511265216:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219352.450503:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22817:x1804827511265216:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 350us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.450517:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 978 00000100:00100000:0.0:1721219352.451461:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.451612:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265280 00000100:00100000:1.0:1721219352.451656:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 979 00000100:00100000:1.0:1721219352.451662:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22817:x1804827511265280:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1721219352.451946:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22817:x1804827511265280:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 281us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.451957:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 979 00000100:00100000:0.0:1721219352.452925:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.453047:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265344 00000100:00100000:1.0:1721219352.453102:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 980 00000100:00100000:1.0:1721219352.453108:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265344:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219352.453118:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219352.453128:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72afa expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.453147:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 9 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.453156:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 9 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.453162:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd21200, rc 0) 00000100:00100000:1.0:1721219352.453209:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511265344:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 100us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.453216:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 980 00000100:00100000:0.0:1721219352.453983:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.454075:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265408 00000100:00100000:1.0:1721219352.454127:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 981 00000100:00100000:1.0:1721219352.454135:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511265408:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219352.454254:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511265408:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 117us (267us total) trans 0 rc -2/-2 00000100:00100000:1.0:1721219352.454267:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 981 00000020:00000080:3.0:1721219352.832012:0:14099:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1721219352.832022:0:14099:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1721219352.832027:0:14099:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1721219352.832609:0:14099:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:3.0:1721219352.832618:0:14099:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:3.0:1721219352.832656:0:14099:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_22c.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1721219352.833369:0:14100:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 102 marker 67 1->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0001_UUID 20000000:01000000:3.0:1721219352.833431:0:14100:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 104 marker 67 2->4: lustre-MDT0000-mdtlov add lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:3.0:1721219352.833540:0:14100:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 108 count 106 00000040:00080000:1.0:1721219352.833977:0:14099:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].108, 224 off28304 20000000:01000000:1.0:1721219352.833994:0:14099:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre test_22c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1721219352.834041:0:14099:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].109, 144 off28448 00000040:00080000:1.0:1721219352.834088:0:14099:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].110, 224 off28672 20000000:01000000:1.0:1721219352.834714:0:14099:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.test_22c.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1721219352.835428:0:14101:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 106 marker 68 1->4: lustre-clilov add lustre.test_22c.lustre-OST0001_UUID 20000000:01000000:3.0:1721219352.835541:0:14101:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 108 marker 68 2->4: lustre-clilov add lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:3.0:1721219352.835649:0:14101:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 112 count 111 00000040:00080000:1.0:1721219352.836003:0:14099:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].112, 224 off28616 20000000:01000000:1.0:1721219352.836035:0:14099:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce022 lustre test_22c lustre-OST0001_UUID (null) 00000040:00080000:1.0:1721219352.836159:0:14099:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].113, 136 off28752 00000040:00080000:1.0:1721219352.836218:0:14099:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].114, 224 off28976 10000000:01000000:1.0:1721219352.836232:0:14099:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1721219352.836249:0:14099:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836265:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0018dc expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836272:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0018ea expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836277:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836282:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001906 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836287:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001914 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836293:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001922 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836298:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001930 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836307:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836313:0:14099:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836331:0:14099:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836369:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836382:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 8 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.836396:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588672:192.168.201.58@tcp:104: 00010000:00010000:1.0:1721219352.836524:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836533:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 8 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.836541:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588736:192.168.201.58@tcp:104: 00010000:00010000:1.0:1721219352.836593:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001930 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836600:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001930 expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.836609:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ac2ac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588800:0@lo:104: 00000100:00100000:1.0:1721219352.836646:0:14099:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219352.836685:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001922 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.836692:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001922 expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.836708:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ac0e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588864:0@lo:104: 00010000:00010000:1.0:1721219352.836731:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001914 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.836732:0:8340:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1721219352.836738:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001914 expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.836744:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ac3440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588928:0@lo:104: 00000100:00100000:3.0:1721219352.836760:0:8340:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219352.836804:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588800 00000100:00100000:1.0:1721219352.836804:0:14099:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219352.836825:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588864 00010000:00010000:1.0:1721219352.836833:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001906 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.836846:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588928 00010000:00010000:1.0:1721219352.836848:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001906 expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:0.0:1721219352.836859:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1721219352.836860:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880134ac76c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588992:0@lo:104: 00000100:00100000:0.0:1721219352.836865:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880090b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459588800:12345-0@lo:104: 00000100:00100000:3.0:1721219352.836871:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1721219352.836876:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae54740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459588864:12345-0@lo:104: 00000100:00100000:1.0:1721219352.836885:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1721219352.836894:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459588928:12345-0@lo:104: 00010000:00010000:0.0:1721219352.836944:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1721219352.836948:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880090b0d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459588800:12345-0@lo:104: Request processed in 84us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219352.836954:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00010000:00010000:3.0:1721219352.836959:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1721219352.836965:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae54740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14099:x1804827459588864:12345-0@lo:104: Request processed in 89us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219352.836972:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00010000:00010000:1.0:1721219352.836981:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1721219352.836990:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ac0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14099:x1804827459588928:12345-0@lo:104: Request processed in 97us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.837001:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00010000:00010000:3.0:1721219352.837007:0:8341:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1721219352.837011:0:8341:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837021:0:8341:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e7cc0 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219352.837024:0:8341:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837031:0:8341:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219352.837037:0:8341:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.837053:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1721219352.837054:0:14099:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721219352.837061:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837063:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:01000000:3.0:1721219352.837064:0:8341:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219352.837067:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.837072:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5f80 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:2.0:1721219352.837074:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837077:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5b00 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219352.837079:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219352.837083:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459588992 00010000:00010000:2.0:1721219352.837084:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837085:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219352.837088:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219352.837090:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219352.837092:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1721219352.837096:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219352.837101:0:8341:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219352.837110:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00010000:00010000:3.0:1721219352.837111:0:8341:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1721219352.837115:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ac0980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14099:x1804827459588992:12345-0@lo:104: 00010000:00010000:0.0:1721219352.837116:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837119:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219352.837121:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837133:0:8341:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.837135:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219352.837140:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837143:0:8341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001930 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001937 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837144:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e5b00/0xd4836d281e001914 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00191b expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.837145:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.837151:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e5f80/0xd4836d281e001922 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001929 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837153:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219352.837154:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837156:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5440 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219352.837157:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.837158:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:3.0:1721219352.837160:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.837161:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837163:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.837163:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:0.0:1721219352.837164:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.837165:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219352.837166:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1721219352.837166:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219352.837167:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219352.837174:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ac0980 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14099:x1804827459588992:12345-0@lo:104: Request processed in 57us (120us total) trans 0 rc 0/0 00010000:00010000:0.0:1721219352.837175:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.837178:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219352.837182:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.837184:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459589056:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1721219352.837184:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00010000:0.0:1721219352.837184:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001906 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00190d expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219352.837190:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459589184:0@lo:103:ldlm_bl_04.0 00010000:00010000:0.0:1721219352.837190:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.837191:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.837196:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219352.837209:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459589248:0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219352.837215:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee90980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459589120:0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219352.837226:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219352.837235:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219352.837251:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219352.837258:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219352.837271:0:6719:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589056 00000100:00100000:1.0:1721219352.837275:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219352.837288:0:6719:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001930 expref: 18 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:0.0:1721219352.837299:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589248 00000100:00100000:2.0:1721219352.837300:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589184 00000100:00100000:3.0:1721219352.837309:0:6719:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589120 00010000:00010000:0.0:1721219352.837312:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001906 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:2.0:1721219352.837316:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001922 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:3.0:1721219352.837317:0:6719:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001914 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.837321:0:15873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179009 00000100:00100000:1.0:1721219352.837329:0:15873:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e28e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2850:x1804827459589056:12345-0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1721219352.837339:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179010 00000100:00100000:0.0:1721219352.837343:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee95f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2849:x1804827459589248:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219352.837344:0:6719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179011 00010000:00010000:1.0:1721219352.837344:0:15873:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721219352.837349:0:6719:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880134ac63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2851:x1804827459589120:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:2.0:1721219352.837349:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179012 00010000:00010000:1.0:1721219352.837350:0:15873:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001930 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:0.0:1721219352.837350:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219352.837353:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001906 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:2.0:1721219352.837354:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf6b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2852:x1804827459589184:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:3.0:1721219352.837358:0:6719:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219352.837359:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001906 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:3.0:1721219352.837361:0:6719:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001914 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:2.0:1721219352.837364:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219352.837366:0:15873:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001930 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:2.0:1721219352.837367:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001922 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:2.0:1721219352.837377:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001922 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:3.0:1721219352.837392:0:6719:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001914 expref: 21 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.837406:0:15873:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219352.837413:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721219352.837414:0:6719:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721219352.837422:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721219352.837457:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf6b900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2852:x1804827459589184:12345-0@lo:103:ldlm_bl_04.0 Request processed in 102us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.837457:0:15873:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e28e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2850:x1804827459589056:12345-0@lo:103:ldlm_bl_03.0 Request processed in 127us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219352.837458:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee95f00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2849:x1804827459589248:12345-0@lo:103:ldlm_bl_02.0 Request processed in 114us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219352.837460:0:6719:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880134ac63c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2851:x1804827459589120:12345-0@lo:103:ldlm_bl_02.0 Request processed in 110us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219352.837463:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179010 00000100:00100000:2.0:1721219352.837467:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179012 00000100:00100000:3.0:1721219352.837517:0:6719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179011 00000100:00100000:1.0:1721219352.837524:0:15873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179009 00000100:00100000:3.0:1721219352.837586:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459589056:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1721219352.837612:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459589184:0@lo:103:ldlm_bl_04.0 00000100:00100000:0.0:1721219352.837614:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219352.837633:0:13966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265472 00000100:00100000:0.0:1721219352.837636:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1721219352.837638:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837651:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.837652:0:13966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 9 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.837660:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459589312:0@lo:104: 00000100:00100000:3.0:1721219352.837680:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265536 00000100:00100000:0.0:1721219352.837682:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459589248:0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219352.837685:0:13966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179013 00010000:00010000:3.0:1721219352.837692:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 10 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.837694:0:13966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee917c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1836:x1804827511265472:12345-192.168.201.58@tcp:103:ldlm_bl_07.0 00010000:00010000:1.0:1721219352.837707:0:13966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219352.837711:0:13966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 10 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.837716:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179014 00000100:00100000:3.0:1721219352.837721:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511265536:12345-192.168.201.58@tcp:103:ldlm_bl_03.0 00010000:00010000:3.0:1721219352.837728:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721219352.837731:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 10 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.837733:0:13966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 10 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:3.0:1721219352.837742:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 10 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.837776:0:13966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721219352.837777:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219352.837820:0:13966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee917c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1836:x1804827511265472:12345-192.168.201.58@tcp:103:ldlm_bl_07.0 Request processed in 127us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219352.837822:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511265536:12345-192.168.201.58@tcp:103:ldlm_bl_03.0 Request processed in 98us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.837828:0:13966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179013 00000100:00100000:3.0:1721219352.837835:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179014 00000100:00100000:1.0:1721219352.837875:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee90980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459589120:0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219352.837892:0:14099:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219352.837940:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0018ea expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.837949:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0018ea expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.837958:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae51c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459589376:0@lo:104: 00000100:00100000:2.0:1721219352.837973:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589312 00000100:00100000:3.0:1721219352.837978:0:14099:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219352.838005:0:14099:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0018dc expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.838012:0:14099:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0018dc expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838019:0:14099:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae50980 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459589440:0@lo:104: 00000100:00100000:2.0:1721219352.838027:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589376 00000100:00100000:3.0:1721219352.838032:0:14099:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219352.838051:0:14099:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c59a80 going to sleep for 6 seconds 00000100:00100000:1.0:1721219352.838051:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589440 00000100:00100000:0.0:1721219352.838053:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1721219352.838059:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459589312:12345-0@lo:104: 00000100:00100000:2.0:1721219352.838060:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1721219352.838065:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae56d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459589376:12345-0@lo:104: 00000100:00100000:3.0:1721219352.838067:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1721219352.838072:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459589440:12345-0@lo:104: 00010000:00010000:0.0:1721219352.838086:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1721219352.838089:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:14099:x1804827459589312:12345-0@lo:104: Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219352.838099:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00010000:00010000:1.0:1721219352.838101:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219352.838103:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1721219352.838107:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219352.838108:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14099:x1804827459589440:12345-0@lo:104: Request processed in 36us (75us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219352.838110:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219352.838112:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae56d40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14099:x1804827459589376:12345-0@lo:104: Request processed in 47us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219352.838114:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00010000:00010000:1.0:1721219352.838118:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5680 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:1.0:1721219352.838120:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.838123:0:8341:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1721219352.838125:0:8341:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838126:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219352.838129:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00010000:00010000:0.0:1721219352.838130:0:8341:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e7180 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:1.0:1721219352.838132:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219352.838132:0:8341:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219352.838136:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219352.838136:0:8341:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219352.838139:0:8341:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219352.838141:0:8341:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219352.838146:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1721219352.838149:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.838156:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd21200/0xd4836d281e001945 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72afa expref: 8 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:2.0:1721219352.838156:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6880 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:0.0:1721219352.838157:0:8341:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219352.838158:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.838160:0:8341:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219352.838163:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838165:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.838167:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588672:192.168.201.58@tcp:104: 10000000:00010000:2.0:1721219352.838169:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838171:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1721219352.838173:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219352.838173:0:8341:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.838176:0:8341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e0018dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018e3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.838182:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459589504:0@lo:103:ldlm_bl_03.0 00010000:00010000:1.0:1721219352.838182:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219352.838183:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.838184:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219352.838185:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.838190:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.838195:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219352.838196:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e5680/0xd4836d281e0018f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018ff expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219352.838202:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.838205:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219352.838207:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219352.838209:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219352.838210:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459589632:0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219352.838211:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.838219:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e6880/0xd4836d281e0018ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0018f1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219352.838223:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137122600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459589568:0@lo:103:ldlm_bl_01.0 00000100:00100000:0.0:1721219352.838229:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721219352.838231:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.838232:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219352.838234:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219352.838235:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd23180/0xd4836d281e00193e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72af3 expref: 7 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838246:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588736:192.168.201.58@tcp:104: 00000100:00100000:1.0:1721219352.838254:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219352.838261:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589504 00010000:00010000:3.0:1721219352.838272:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0018dc expref: 18 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:1.0:1721219352.838284:0:13966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589632 00000100:00100000:3.0:1721219352.838288:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589568 00010000:00010000:3.0:1721219352.838294:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 20 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.838296:0:13966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0018ea expref: 20 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:0.0:1721219352.838296:0:6717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179015 00000100:00100000:0.0:1721219352.838299:0:6717:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2850:x1804827459589504:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1721219352.838305:0:6717:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219352.838308:0:6717:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0018dc expref: 20 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:0.0:1721219352.838314:0:6717:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0018dc expref: 20 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:0.0:1721219352.838321:0:6717:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721219352.838323:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179016 00000100:00100000:3.0:1721219352.838327:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137124280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2851:x1804827459589568:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219352.838335:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721219352.838338:0:13966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179017 00010000:00010000:3.0:1721219352.838339:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 20 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:0.0:1721219352.838341:0:6717:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2850:x1804827459589504:12345-0@lo:103:ldlm_bl_03.0 Request processed in 41us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219352.838343:0:13966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e28e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2852:x1804827459589632:12345-0@lo:103:ldlm_bl_04.0 00000100:00100000:0.0:1721219352.838346:0:6717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179015 00010000:00010000:3.0:1721219352.838347:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 20 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.838350:0:13966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219352.838354:0:13966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0018ea expref: 19 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:3.0:1721219352.838359:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219352.838362:0:13966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0018ea expref: 19 pid: 27118 timeout: 1898 lvb_type: 0 00010000:00010000:1.0:1721219352.838374:0:13966:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838381:0:13966:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.838385:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137124280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+19:2851:x1804827459589568:12345-0@lo:103:ldlm_bl_01.0 Request processed in 57us (132us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219352.838391:0:13966:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219352.838399:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137122600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459589568:0@lo:103:ldlm_bl_01.0 00000100:00100000:3.0:1721219352.838402:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179016 00010000:00010000:1.0:1721219352.838408:0:13966:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838414:0:13966:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838419:0:13966:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838424:0:13966:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cd21680 already unused, calling callback (ffffffffa0815190) 00010000:00010000:1.0:1721219352.838427:0:13966:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838432:0:13966:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219352.838435:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee95a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459589504:0@lo:103:ldlm_bl_03.0 00010000:00010000:1.0:1721219352.838438:0:13966:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219352.838448:0:13966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721219352.838457:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd20000/0xd4836d281e001937 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001930 expref: 18 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838466:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ac2ac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588800:0@lo:104: 00010000:00010000:3.0:1721219352.838504:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd221c0/0xd4836d281e001929 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001922 expref: 17 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:0.0:1721219352.838507:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459589632:0@lo:103:ldlm_bl_04.0 00000100:00100000:1.0:1721219352.838511:0:13966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e28e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:2852:x1804827459589632:12345-0@lo:103:ldlm_bl_04.0 Request processed in 166us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219352.838513:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ac0e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588864:0@lo:104: 00000100:00100000:1.0:1721219352.838518:0:13966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179017 00010000:00010000:3.0:1721219352.838520:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0c000/0xd4836d281e00191b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001914 expref: 16 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838527:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ac3440 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588928:0@lo:104: 00010000:00010000:3.0:1721219352.838534:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0db00/0xd4836d281e00190d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001906 expref: 14 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838540:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880134ac76c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459588992:0@lo:104: 00010000:00010000:3.0:1721219352.838548:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0cd80/0xd4836d281e0018ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0018f8 expref: 13 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838578:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459589312:0@lo:104: 00010000:00010000:3.0:1721219352.838585:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0cb40/0xd4836d281e0018f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0018ea expref: 12 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838592:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae51c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459589376:0@lo:104: 00010000:00010000:3.0:1721219352.838598:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0f840/0xd4836d281e0018e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0018dc expref: 11 pid: 27118 timeout: 1898 lvb_type: 0 00000100:00100000:3.0:1721219352.838618:0:14099:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae50980 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14099:1804827459589440:0@lo:104: 00010000:00010000:3.0:1721219352.838655:0:14099:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.838662:0:14099:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.838668:0:14099:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219352.838673:0:14099:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd21680/0xd4836d281e00194c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14099 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.096640:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219353.096648:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a6512800 from 112 10000000:01000000:0.0:1721219353.096654:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219353.096706:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.096719:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.096732:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.096759:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459589696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.096835:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.096894:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9240 going to sleep for 6 seconds 00000100:00100000:1.0:1721219353.096999:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589696 00000100:00100000:1.0:1721219353.097052:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 982 00000100:00100000:1.0:1721219353.097057:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:6729:x1804827459589696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219353.097073:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219353.097086:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001953 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.097108:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001953 expref: 12 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.097129:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001953 expref: 12 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219353.097137:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd21680, rc 0) 00000100:00100000:1.0:1721219353.097200:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459589696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 142us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219353.097208:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 982 00000100:00100000:0.0:1721219353.097255:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459589696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219353.097275:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.097285:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.097353:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459589760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.097381:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.097409:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9240 going to sleep for 6 seconds 00000100:00100000:1.0:1721219353.097443:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589760 00000100:00100000:1.0:1721219353.097511:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 983 00000100:00100000:1.0:1721219353.097516:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459589760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219353.097703:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459589760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219353.097711:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 983 00000100:00100000:0.0:1721219353.097763:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459589760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.097800:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459589824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.097848:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.097875:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9240 going to sleep for 6 seconds 00000100:00100000:1.0:1721219353.097906:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589824 00000100:00100000:1.0:1721219353.097933:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 984 00000100:00100000:1.0:1721219353.097938:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459589824:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219353.098136:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459589824:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219353.098143:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 984 00000100:00100000:0.0:1721219353.098170:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459589824:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219353.098534:0:14102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14102:1804827459589888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.098604:0:14102:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.098629:0:14102:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.098663:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589888 00000100:00100000:2.0:1721219353.098703:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 985 00000100:00100000:2.0:1721219353.098709:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14102:x1804827459589888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.099055:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14102:x1804827459589888:12345-0@lo:502:llog_process_th.0 Request processed in 345us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.099069:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 985 00000100:00100000:1.0:1721219353.099095:0:14102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14102:1804827459589888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.099144:0:14102:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14102:1804827459589952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.099191:0:14102:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.099222:0:14102:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.099248:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459589952 00000100:00100000:2.0:1721219353.099276:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 986 00000100:00100000:2.0:1721219353.099280:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14102:x1804827459589952:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.099517:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14102:x1804827459589952:12345-0@lo:502:llog_process_th.0 Request processed in 235us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.099525:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 986 00000100:00100000:1.0:1721219353.099531:0:14102:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14102:1804827459589952:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219353.099596:0:14102:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 115 count 114 00000020:01000000:0.0:1721219353.099667:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 112-114 (rc=0) 10000000:01000000:0.0:1721219353.099687:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219353.099690:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.099696:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.099702:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1721219353.099703:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 108 10000000:01000000:0.0:1721219353.099704:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1721219353.099716:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.099724:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.099729:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.099737:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.099764:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.099774:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9240 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.099787:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590016 00000100:00100000:2.0:1721219353.099810:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 987 00000100:00100000:2.0:1721219353.099813:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459590016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.099821:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219353.099831:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001961 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.099849:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001961 expref: 13 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.099865:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001961 expref: 13 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.099871:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e6640, rc 0) 00000100:00100000:2.0:1721219353.099919:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459590016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.099926:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 987 00000100:00100000:0.0:1721219353.099939:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219353.099946:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.099951:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.099975:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.099993:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.100001:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9240 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.100012:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590080 00000100:00100000:2.0:1721219353.100029:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 988 00000100:00100000:2.0:1721219353.100032:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459590080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.100122:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459590080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 88us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.100129:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 988 00000100:00100000:0.0:1721219353.100140:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.100156:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.100188:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.100196:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9240 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.100208:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590144 00000100:00100000:2.0:1721219353.100223:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 989 00000100:00100000:2.0:1721219353.100226:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459590144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.100402:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459590144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 173us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.100409:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 989 00000100:00100000:0.0:1721219353.100417:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219353.100715:0:14103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14103:1804827459590208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.100767:0:14103:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.100794:0:14103:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.100826:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590208 00000100:00100000:2.0:1721219353.100858:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 990 00000100:00100000:2.0:1721219353.100861:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14103:x1804827459590208:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.101163:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14103:x1804827459590208:12345-0@lo:502:llog_process_th.0 Request processed in 299us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.101170:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 990 00000100:00100000:1.0:1721219353.101201:0:14103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14103:1804827459590208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1721219353.101236:0:14103:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219353.101244:0:14103:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219353.101246:0:14103:0:(obd_config.c:1460:class_process_config()) marker 71 (0x1) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0001_UUID 00000020:00000080:1.0:1721219353.101251:0:14103:0:(obd_config.c:1384:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1721219353.101264:0:14103:0:(lod_pool.c:669:lod_pool_remove()) lustre-OST0001_UUID removed from test_22c 00000020:01000004:1.0:1721219353.101494:0:14104:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff8800a6512800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1721219353.101498:0:14104:0:(obd_mount.c:668:lustre_put_lsi()) put ffff8800a6512800 4 00000100:00100000:2.0:1721219353.101525:0:14103:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6b900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14103:1804827459590272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.101591:0:14103:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219353.101614:0:14103:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800999cc840 going to sleep for 6 seconds 00000100:00100000:0.0:1721219353.101721:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590272 00000100:00100000:0.0:1721219353.101776:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 991 00000100:00100000:0.0:1721219353.101782:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14103:x1804827459590272:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219353.102139:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14103:x1804827459590272:12345-0@lo:502:llog_process_th.0 Request processed in 355us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219353.102149:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 991 00000100:00100000:2.0:1721219353.102176:0:14103:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6b900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14103:1804827459590272:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1721219353.102206:0:14103:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1721219353.102211:0:14103:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1721219353.102213:0:14103:0:(obd_config.c:1460:class_process_config()) marker 71 (0x2) lustre-MDT0000-m rem lustre.test_22c.lustre-OST0001_UUID 00000040:00080000:2.0:1721219353.102216:0:14103:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 111 count 109 00000020:01000000:0.0:1721219353.102250:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 108-110 (rc=0) 10000000:01000000:0.0:1721219353.102271:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1721219353.102275:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.102285:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.102294:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219353.102296:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880136319800 from 112 10000000:01000000:0.0:1721219353.102298:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219353.102315:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.102322:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.102329:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.102342:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.102372:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.102386:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9f00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.102399:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590336 00000100:00100000:2.0:1721219353.102421:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 992 00000100:00100000:2.0:1721219353.102425:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459590336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.102432:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219353.102441:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e00196f expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.102455:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e00196f expref: 14 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.102462:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00196f expref: 14 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.102468:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e4fc0, rc 0) 00000100:00100000:2.0:1721219353.102537:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459590336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.102544:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 992 00000100:00100000:0.0:1721219353.102606:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219353.102619:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.102635:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.102678:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.102706:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.102721:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9f00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.102730:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590400 00000100:00100000:2.0:1721219353.102755:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 993 00000100:00100000:2.0:1721219353.102759:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459590400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.102866:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459590400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 106us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.102873:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 993 00000100:00100000:0.0:1721219353.102901:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.102928:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.102976:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.102989:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9f00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.102998:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590464 00000100:00100000:2.0:1721219353.103015:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 994 00000100:00100000:2.0:1721219353.103018:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459590464:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.103180:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459590464:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 160us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.103187:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 994 00000100:00100000:0.0:1721219353.103193:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590464:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219353.103463:0:14105:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14105:1804827459590528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.103604:0:14105:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.103641:0:14105:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.103666:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590528 00000100:00100000:2.0:1721219353.103698:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 995 00000100:00100000:2.0:1721219353.103702:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14105:x1804827459590528:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.103982:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14105:x1804827459590528:12345-0@lo:502:llog_process_th.0 Request processed in 277us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.103990:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 995 00000100:00100000:1.0:1721219353.104082:0:14105:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14105:1804827459590528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.104136:0:14105:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14105:1804827459590592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.104179:0:14105:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.104195:0:14105:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.104202:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590592 00000100:00100000:2.0:1721219353.104226:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 996 00000100:00100000:2.0:1721219353.104229:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14105:x1804827459590592:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.104423:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14105:x1804827459590592:12345-0@lo:502:llog_process_th.0 Request processed in 192us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.104431:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 996 00000100:00100000:1.0:1721219353.104458:0:14105:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14105:1804827459590592:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219353.104514:0:14105:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 115 count 114 00000020:01000000:0.0:1721219353.104588:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 112-114 (rc=0) 10000000:01000000:0.0:1721219353.104608:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219353.104612:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.104619:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.104626:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1721219353.104629:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1721219353.104631:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1721219353.104646:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.104652:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.104672:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.104685:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.104716:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.104745:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62b2900 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.104779:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590656 00000100:00100000:2.0:1721219353.104802:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 997 00000100:00100000:2.0:1721219353.104806:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459590656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.104812:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219353.104828:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e00197d expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.104842:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e00197d expref: 15 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.104848:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00197d expref: 15 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.104854:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e61c0, rc 0) 00000100:00100000:2.0:1721219353.104899:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459590656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.104906:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 997 00000100:00100000:0.0:1721219353.104935:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219353.104946:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.104953:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.104991:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.105016:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.105027:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62b2900 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.105038:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590720 00000100:00100000:2.0:1721219353.105055:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 998 00000100:00100000:2.0:1721219353.105058:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459590720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.105151:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459590720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.105158:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 998 00000100:00100000:0.0:1721219353.105183:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.105207:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590784:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.105253:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.105265:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62b2900 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.105275:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590784 00000100:00100000:2.0:1721219353.105291:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 999 00000100:00100000:2.0:1721219353.105294:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459590784:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.105518:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459590784:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.105525:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 999 00000100:00100000:0.0:1721219353.105530:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590784:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1721219353.106355:0:14106:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:0.0:1721219353.106447:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1721219353.106502:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1721219353.106506:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.106526:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.106534:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219353.106536:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009928e000 from 112 10000000:01000000:0.0:1721219353.106537:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219353.106576:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.106582:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.106589:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.106601:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590848:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.106631:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.106656:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9f00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.106693:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590848 00000100:00100000:2.0:1721219353.106716:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1000 00000100:00100000:2.0:1721219353.106719:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459590848:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.106735:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219353.106744:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e00198b expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.106757:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e00198b expref: 16 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.106764:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00198b expref: 16 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.106770:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5200, rc 0) 00000100:00100000:2.0:1721219353.106816:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459590848:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.106822:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1000 00000100:00100000:0.0:1721219353.106850:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590848:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219353.106861:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.106868:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.106904:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.106928:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.106940:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9f00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.106950:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590912 00000100:00100000:2.0:1721219353.106967:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1001 00000100:00100000:2.0:1721219353.106970:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459590912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.107041:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459590912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.107047:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1001 00000100:00100000:0.0:1721219353.107053:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.107086:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.107123:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.107135:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880134cc9f00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.107145:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459590976 00000100:00100000:2.0:1721219353.107160:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1002 00000100:00100000:2.0:1721219353.107163:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459590976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.107328:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459590976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.107336:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1002 00000100:00100000:0.0:1721219353.107362:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459590976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219353.107803:0:14107:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14107:1804827459591040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.107853:0:14107:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.107880:0:14107:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.107982:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591040 00000100:00100000:2.0:1721219353.108040:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1003 00000100:00100000:2.0:1721219353.108045:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14107:x1804827459591040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.108352:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14107:x1804827459591040:12345-0@lo:502:llog_process_th.0 Request processed in 304us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.108361:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1003 00000100:00100000:1.0:1721219353.108398:0:14107:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14107:1804827459591040:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.108445:0:14107:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14107:1804827459591104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219353.108517:0:14107:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219353.108540:0:14107:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1c599c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.108587:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591104 00000100:00100000:2.0:1721219353.108620:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1004 00000100:00100000:2.0:1721219353.108624:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14107:x1804827459591104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219353.108830:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14107:x1804827459591104:12345-0@lo:502:llog_process_th.0 Request processed in 204us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.108838:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1004 00000100:00100000:1.0:1721219353.108862:0:14107:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14107:1804827459591104:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219353.108890:0:14107:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 115 count 114 00000020:01000000:0.0:1721219353.108942:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 112-114 (rc=0) 10000000:01000000:0.0:1721219353.108958:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219353.108961:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.108967:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.108973:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1721219353.108974:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1721219353.108976:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1721219353.108987:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.108992:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.108997:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.109006:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591168:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.109042:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.109068:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62b2900 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.109101:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591168 00000100:00100000:2.0:1721219353.109124:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1005 00000100:00100000:2.0:1721219353.109127:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459591168:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.109134:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219353.109143:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001999 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.109160:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001999 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.109168:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001999 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.109174:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5d40, rc 0) 00000100:00100000:2.0:1721219353.109205:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459591168:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 77us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.109211:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1005 00000100:00100000:0.0:1721219353.109218:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591168:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219353.109236:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.109242:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.109269:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.109290:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.109299:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62b2900 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.109311:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591232 00000100:00100000:2.0:1721219353.109328:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1006 00000100:00100000:2.0:1721219353.109331:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459591232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.109410:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459591232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.109416:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1006 00000100:00100000:0.0:1721219353.109418:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.109434:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.109492:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.109502:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62b2900 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.109513:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591296 00000100:00100000:2.0:1721219353.109529:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1007 00000100:00100000:2.0:1721219353.109532:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459591296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.109734:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459591296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219353.109741:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1007 00000100:00100000:0.0:1721219353.109744:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591296:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1721219353.110663:0:14108:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:0.0:1721219353.110792:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1721219353.110820:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1721219353.110824:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.110835:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219353.110844:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219353.110846:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6c10000 from 1 10000000:01000000:0.0:1721219353.110849:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219353.110866:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.110886:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.110894:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.110908:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.110945:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.110979:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088cc2600 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.111085:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591360 00000100:00100000:2.0:1721219353.111130:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1008 00000100:00100000:2.0:1721219353.111136:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459591360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219353.111146:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219353.111155:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0019a7 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.111173:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 18 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.111181:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 18 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219353.111187:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e46c0, rc 0) 00000100:00100000:2.0:1721219353.111230:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459591360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 94us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219353.111245:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.111251:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1008 00010000:00010000:0.0:1721219353.111260:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.111268:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219353.111308:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219353.111334:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219353.111346:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088cc2600 going to sleep for 6 seconds 00000100:00100000:2.0:1721219353.111358:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591424 00000100:00100000:2.0:1721219353.111378:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1009 00000100:00100000:2.0:1721219353.111381:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459591424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219353.111453:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459591424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (119us total) trans 0 rc -2/-2 00000100:00100000:2.0:1721219353.111459:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1009 00000100:00100000:0.0:1721219353.111465:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459591424:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219353.111520:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219353.111524:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.111530:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219353.151677:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219354.115690:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219354.115742:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265600 00000100:00100000:2.0:1721219354.115784:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1010 00000100:00100000:2.0:1721219354.115790:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:4616:x1804827511265600:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219354.115802:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219354.115814:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b01 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.115836:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.115843:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.115849:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e4000, rc 0) 00000100:00100000:2.0:1721219354.115900:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265600:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 110us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219354.115905:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1010 00000100:00100000:0.0:1721219354.116702:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219354.116748:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265664 00000100:00100000:2.0:1721219354.116779:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1011 00000100:00100000:2.0:1721219354.116783:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265664:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219354.116893:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265664:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 108us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219354.116899:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1011 00000100:00100000:2.0:1721219354.117683:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219354.117725:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265728 00000100:00100000:3.0:1721219354.117756:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1012 00000100:00100000:3.0:1721219354.117761:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265728:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.117957:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265728:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 195us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.117962:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1012 00000100:00100000:0.0:1721219354.118865:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219354.118889:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265792 00000100:00100000:3.0:1721219354.118902:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1013 00000100:00100000:3.0:1721219354.118905:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22836:x1804827511265792:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219354.119121:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22836:x1804827511265792:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 214us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.119126:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1013 00000100:00100000:0.0:1721219354.120031:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219354.120097:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265856 00000100:00100000:3.0:1721219354.120126:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1014 00000100:00100000:3.0:1721219354.120129:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22836:x1804827511265856:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219354.120242:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22836:x1804827511265856:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 112us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.120247:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1014 00000100:00100000:2.0:1721219354.121104:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219354.121175:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265920 00000100:00100000:3.0:1721219354.121193:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1015 00000100:00100000:3.0:1721219354.121196:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511265920:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219354.121202:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219354.121213:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b08 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.121229:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 9 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.121235:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 9 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.121240:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5451f80, rc 0) 00000100:00100000:3.0:1721219354.121258:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511265920:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 62us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.121262:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1015 00000100:00100000:0.0:1721219354.121895:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219354.121930:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511265984 00000100:00100000:3.0:1721219354.121942:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1016 00000100:00100000:3.0:1721219354.121945:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511265984:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219354.121999:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511265984:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 54us (106us total) trans 0 rc -2/-2 00000100:00100000:3.0:1721219354.122010:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1016 00010000:00010000:0.0:1721219354.153628:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1721219354.387154:0:14240:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:1.0:1721219354.387163:0:14240:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1721219354.387167:0:14240:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1721219354.387716:0:14240:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:1.0:1721219354.387725:0:14240:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:1.0:1721219354.387763:0:14240:0:(mgs_llog.c:926:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_22c fl=4 20000000:01000000:1.0:1721219354.389006:0:14241:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 96 marker 63 1->4: lustre-MDT0000-mdtlov new lustre.test_22c 20000000:01000000:1.0:1721219354.389116:0:14241:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 98 marker 63 2->4: lustre-MDT0000-mdtlov new lustre.test_22c 00000040:00080000:1.0:1721219354.389211:0:14241:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 111 count 109 00000040:00080000:2.0:1721219354.389615:0:14240:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].111, 224 off28896 20000000:01000000:2.0:1721219354.389631:0:14240:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre test_22c (null) (null) 00000040:00080000:2.0:1721219354.389683:0:14240:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].112, 120 off29016 00000040:00080000:2.0:1721219354.389769:0:14240:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].113, 224 off29240 20000000:01000000:2.0:1721219354.390375:0:14240:0:(mgs_llog.c:926:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.test_22c fl=4 20000000:01000000:1.0:1721219354.391221:0:14242:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 100 marker 64 1->4: lustre-clilov new lustre.test_22c 20000000:01000000:1.0:1721219354.391312:0:14242:0:(mgs_llog.c:893:mgs_modify_handler()) Changing rec 102 marker 64 2->4: lustre-clilov new lustre.test_22c 00000040:00080000:1.0:1721219354.391430:0:14242:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 115 count 114 00000040:00080000:2.0:1721219354.391857:0:14240:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].115, 224 off29200 20000000:01000000:2.0:1721219354.391870:0:14240:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce023 lustre test_22c (null) (null) 00000040:00080000:2.0:1721219354.391919:0:14240:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].116, 112 off29312 00000040:00080000:2.0:1721219354.391967:0:14240:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].117, 224 off29536 10000000:01000000:2.0:1721219354.391981:0:14240:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1721219354.391995:0:14240:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392009:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001953 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392016:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001961 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392022:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00196f expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392027:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00197d expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392032:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e00198b expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392046:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001999 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392051:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392059:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392065:0:14240:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392071:0:14240:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392109:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392122:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 8 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392134:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6b900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591488:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219354.392219:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392226:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 8 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392233:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591552:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219354.392255:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392270:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392279:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf68e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591616:0@lo:104: 00000100:00100000:2.0:1721219354.392326:0:14240:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721219354.392359:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001999 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392367:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001999 expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392373:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6c280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591680:0@lo:104: 00010000:00010000:2.0:1721219354.392390:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e00198b expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392396:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e00198b expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392402:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf697c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591744:0@lo:104: 00010000:00010000:2.0:1721219354.392416:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e00197d expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392422:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e00197d expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392428:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591808:0@lo:104: 00000100:00100000:3.0:1721219354.392431:0:6716:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1721219354.392442:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e00196f expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392448:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e00196f expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392463:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf6aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591872:0@lo:104: 00000100:00100000:3.0:1721219354.392464:0:6716:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219354.392515:0:6716:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219354.392515:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591616 00000100:00100000:3.0:1721219354.392615:0:6716:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219354.392622:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591680 00000100:00100000:3.0:1721219354.392627:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591744 00000100:00100000:0.0:1721219354.392631:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591808 00000100:00100000:0.0:1721219354.392644:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1721219354.392649:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1721219354.392651:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a1c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14240:x1804827459591616:12345-0@lo:104: 00000100:00100000:3.0:1721219354.392655:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14240:x1804827459591680:12345-0@lo:104: 00000100:00100000:2.0:1721219354.392657:0:14240:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219354.392690:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591872 00010000:00010000:2.0:1721219354.392691:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001961 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392705:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001961 expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.392717:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591936:0@lo:104: 00000100:00100000:1.0:1721219354.392725:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1721219354.392732:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+7:14240:x1804827459591808:12345-0@lo:104: 00010000:00010000:0.0:1721219354.392736:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1721219354.392742:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a1c9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+7:14240:x1804827459591616:12345-0@lo:104: Request processed in 93us (417us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219354.392749:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1721219354.392751:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1721219354.392755:0:14240:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219354.392757:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+7:14240:x1804827459591680:12345-0@lo:104: Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.392767:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00010000:00010000:2.0:1721219354.392783:0:14240:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001953 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219354.392795:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459591936 00010000:00010000:2.0:1721219354.392796:0:14240:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001953 expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:0.0:1721219354.392799:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1721219354.392803:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14240:x1804827459591744:12345-0@lo:104: 00010000:00010000:1.0:1721219354.392809:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1721219354.392814:0:14240:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf15580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459592000:0@lo:104: 00000100:00100000:3.0:1721219354.392815:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1721219354.392815:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239c280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14240:x1804827459591808:12345-0@lo:104: Request processed in 84us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.392821:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf104c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14240:x1804827459591872:12345-0@lo:104: 00000100:00100000:1.0:1721219354.392832:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00010000:00010000:0.0:1721219354.392832:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1721219354.392836:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:14240:x1804827459591744:12345-0@lo:104: Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219354.392842:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00010000:00010000:2.0:1721219354.392847:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1721219354.392853:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.392854:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1721219354.392857:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf13900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14240:x1804827459591936:12345-0@lo:104: 00010000:00010000:2.0:1721219354.392864:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0dd40 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:2.0:1721219354.392868:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.392871:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1721219354.392876:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1721219354.392879:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf104c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14240:x1804827459591872:12345-0@lo:104: Request processed in 57us (227us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219354.392880:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.392880:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf13900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:14240:x1804827459591936:12345-0@lo:104: Request processed in 22us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.392887:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 10000000:00010000:2.0:1721219354.392890:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.392894:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00010000:00010000:1.0:1721219354.392900:0:8341:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1721219354.392906:0:8341:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219354.392908:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219354.392916:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1721219354.392920:0:8341:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0c000 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:3.0:1721219354.392923:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219354.392923:0:8341:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.392935:0:8341:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.392939:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0cd80 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219354.392943:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219354.392944:0:8341:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.392950:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.392953:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219354.392953:0:8341:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219354.392960:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:3.0:1721219354.392974:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.392980:0:8341:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219354.392983:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219354.392986:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.392990:0:8341:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219354.392995:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0dd40/0xd4836d281e0019a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ae expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393000:0:8341:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393009:0:8341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e001999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019a0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.393016:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1721219354.393020:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.393020:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.393025:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1721219354.393026:0:8341:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1721219354.393028:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0db00 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:3.0:1721219354.393029:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219354.393030:0:8341:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219354.393031:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.393032:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393039:0:8341:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0f840 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:2.0:1721219354.393040:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.393042:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0cb40 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219354.393044:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219354.393048:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219354.393051:0:8341:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.393051:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219354.393055:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1721219354.393056:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.393057:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393061:0:8341:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219354.393062:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219354.393067:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e00197d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001984 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219354.393072:0:8341:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.393079:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219354.393080:0:8341:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219354.393084:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219354.393084:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.393086:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219354.393088:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219354.393088:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219354.393090:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219354.393095:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219354.393096:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.393098:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.393102:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0cb40/0xd4836d281e00196f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001976 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393103:0:8341:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393112:0:8341:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219354.393113:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219354.393114:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219354.393115:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0db00/0xd4836d281e00198b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001992 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219354.393116:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219354.393117:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459592128:0@lo:103:ldlm_bl_03.0 00010000:00010000:1.0:1721219354.393120:0:8341:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393128:0:8341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001961 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001968 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.393131:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219354.393133:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219354.393136:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219354.393136:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459592064:0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219354.393142:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219354.393143:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219354.393146:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219354.393166:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219354.393183:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459592192:0@lo:103:ldlm_bl_01.0 00000100:00100000:2.0:1721219354.393185:0:14240:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219354.393189:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459592256:0@lo:103:ldlm_bl_04.0 00000100:00100000:3.0:1721219354.393212:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137124c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459592384:0@lo:103:ldlm_bl_03.0 00000100:00100000:2.0:1721219354.393214:0:14240:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009bb93900 going to sleep for 6 seconds 00000100:00100000:0.0:1721219354.393238:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219354.393245:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf68e40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591616:0@lo:104: 00000100:00100000:1.0:1721219354.393261:0:15873:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592128 00000100:00100000:2.0:1721219354.393262:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6c280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591680:0@lo:104: 00000100:00100000:3.0:1721219354.393264:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219354.393276:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf697c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591744:0@lo:104: 00010000:00010000:1.0:1721219354.393285:0:15873:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001999 expref: 18 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:0.0:1721219354.393288:0:13966:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592256 00000100:00100000:2.0:1721219354.393291:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6d580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591808:0@lo:104: 00000100:00100000:2.0:1721219354.393304:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591872:0@lo:104: 00010000:00010000:0.0:1721219354.393304:0:13966:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00198b expref: 19 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.393320:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591936:0@lo:104: 00000100:00100000:3.0:1721219354.393336:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592384 00000100:00100000:1.0:1721219354.393342:0:15873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179018 00000100:00100000:0.0:1721219354.393349:0:13966:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179019 00000100:00100000:1.0:1721219354.393350:0:15873:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2850:x1804827459592128:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1721219354.393354:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001961 expref: 20 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:0.0:1721219354.393354:0:13966:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2852:x1804827459592256:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:0.0:1721219354.393364:0:13966:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219354.393365:0:15873:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219354.393368:0:13966:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00198b expref: 20 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:0.0:1721219354.393376:0:13966:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e00198b expref: 20 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.393380:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179020 00010000:00010000:1.0:1721219354.393380:0:15873:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001999 expref: 20 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.393389:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2850:x1804827459592384:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:0.0:1721219354.393390:0:13966:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5200/0xd4836d281e001992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e00198b expref: 20 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:1.0:1721219354.393394:0:15873:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001999 expref: 20 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:3.0:1721219354.393398:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592000 00010000:00010000:2.0:1721219354.393405:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219354.393407:0:13966:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219354.393412:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001961 expref: 19 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:1.0:1721219354.393415:0:15873:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5d40/0xd4836d281e0019a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001999 expref: 19 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:3.0:1721219354.393423:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00010000:00010000:2.0:1721219354.393425:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001961 expref: 18 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:3.0:1721219354.393430:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf12140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14240:x1804827459592000:12345-0@lo:104: 00000100:00100000:0.0:1721219354.393431:0:13966:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2852:x1804827459592256:12345-0@lo:103:ldlm_bl_04.0 Request processed in 77us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219354.393437:0:13966:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179019 00010000:00010000:1.0:1721219354.393446:0:15873:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721219354.393456:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721219354.393458:0:8342:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e6640/0xd4836d281e001968 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001961 expref: 17 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:2.0:1721219354.393506:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1721219354.393556:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1721219354.393563:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf12140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:14240:x1804827459592000:12345-0@lo:104: Request processed in 133us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219354.393572:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1721219354.393591:0:15873:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:2850:x1804827459592128:12345-0@lo:103:ldlm_bl_03.0 Request processed in 239us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219354.393603:0:15873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179018 00000100:00100000:2.0:1721219354.393607:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:2850:x1804827459592384:12345-0@lo:103:ldlm_bl_03.0 Request processed in 217us (343us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219354.393614:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219354.393618:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219354.393618:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179020 00000100:00100000:0.0:1721219354.393621:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459592320:0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219354.393624:0:15873:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592064 00010000:00010000:3.0:1721219354.393625:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0fcc0 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219354.393627:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.393633:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219354.393638:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.393639:0:15873:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 15 pid: 27118 timeout: 1900 lvb_type: 0 10000000:01000000:3.0:1721219354.393643:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1721219354.393647:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219354.393662:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.393667:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1721219354.393670:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf15580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459592000:0@lo:104: 00010000:00010000:3.0:1721219354.393673:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219354.393678:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001953 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e00195a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219354.393682:0:15873:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592320 00010000:00010000:3.0:1721219354.393690:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219354.393691:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219354.393691:0:15871:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179021 00000100:00100000:2.0:1721219354.393697:0:15871:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:2849:x1804827459592064:12345-0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219354.393697:0:15873:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00196f expref: 16 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:3.0:1721219354.393700:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219354.393708:0:15871:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721219354.393714:0:15871:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 16 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.393721:0:15873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179022 00010000:00010000:2.0:1721219354.393727:0:15871:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 16 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.393727:0:15873:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee963c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:2849:x1804827459592320:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:1.0:1721219354.393738:0:15873:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721219354.393741:0:15871:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e46c0/0xd4836d281e0019ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0019a7 expref: 16 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:1.0:1721219354.393742:0:15873:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00196f expref: 16 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:1.0:1721219354.393752:0:15873:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e00196f expref: 15 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:2.0:1721219354.393760:0:15871:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721219354.393760:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:1.0:1721219354.393766:0:15873:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e4fc0/0xd4836d281e001976 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e00196f expref: 15 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:0.0:1721219354.393791:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:1.0:1721219354.393795:0:15873:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721219354.393801:0:15871:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:2849:x1804827459592064:12345-0@lo:103:ldlm_bl_04.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219354.393811:0:15871:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179021 00000100:00100000:0.0:1721219354.393812:0:6717:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266048 00000100:00100000:1.0:1721219354.393825:0:15873:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee963c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:2849:x1804827459592320:12345-0@lo:103:ldlm_bl_02.0 Request processed in 98us (177us total) trans 0 rc 0/0 00010000:00010000:0.0:1721219354.393829:0:6717:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 9 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.393832:0:15871:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266112 00000100:00100000:1.0:1721219354.393832:0:15873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179022 00010000:00010000:2.0:1721219354.393849:0:15871:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 10 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.393859:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219354.393870:0:6717:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592192 00000100:00100000:2.0:1721219354.393875:0:15871:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179023 00010000:00010000:0.0:1721219354.393881:0:6717:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00197d expref: 13 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.393883:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae56d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459592448:0@lo:103:ldlm_bl_01.0 00000100:00100000:2.0:1721219354.393885:0:15871:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee93440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511266048:12345-192.168.201.58@tcp:103:ldlm_bl_05.0 00000100:00100000:3.0:1721219354.393886:0:6719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179024 00000100:00100000:3.0:1721219354.393892:0:6719:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee94280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1834:x1804827511266112:12345-192.168.201.58@tcp:103:ldlm_bl_02.0 00010000:00010000:2.0:1721219354.393894:0:15871:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721219354.393894:0:6717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179025 00000100:00100000:0.0:1721219354.393897:0:6717:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6679850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:2851:x1804827459592192:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:2.0:1721219354.393900:0:15871:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 10 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:3.0:1721219354.393904:0:6719:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1721219354.393904:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219354.393904:0:6717:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219354.393908:0:6717:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e00197d expref: 13 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:3.0:1721219354.393910:0:6719:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 10 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:0.0:1721219354.393915:0:6717:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e00197d expref: 13 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:3.0:1721219354.393923:0:6719:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 10 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.393924:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592448 00010000:00010000:1.0:1721219354.393934:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001953 expref: 14 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:0.0:1721219354.393935:0:6717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e61c0/0xd4836d281e001984 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e00197d expref: 14 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:2.0:1721219354.393941:0:15871:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 10 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.393947:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179026 00000100:00100000:1.0:1721219354.393950:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137123dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:2851:x1804827459592448:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:1.0:1721219354.393957:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219354.393957:0:6717:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219354.393960:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001953 expref: 13 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:3.0:1721219354.393966:0:6719:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219354.393969:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001953 expref: 13 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:2.0:1721219354.393976:0:15871:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219354.393981:0:25696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd21680/0xd4836d281e00195a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001953 expref: 13 pid: 27118 timeout: 1900 lvb_type: 0 00010000:00010000:1.0:1721219354.393990:0:25696:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.393991:0:6717:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6679850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:2851:x1804827459592192:12345-0@lo:103:ldlm_bl_01.0 Request processed in 93us (132us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219354.393995:0:25696:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.393997:0:6717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179025 00000100:00100000:3.0:1721219354.394000:0:6719:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee94280 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1834:x1804827511266112:12345-192.168.201.58@tcp:103:ldlm_bl_02.0 Request processed in 108us (210us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219354.394006:0:25696:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219354.394008:0:6719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179024 00000100:00100000:2.0:1721219354.394009:0:15871:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee93440 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511266048:12345-192.168.201.58@tcp:103:ldlm_bl_05.0 Request processed in 125us (249us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219354.394018:0:25696:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219354.394021:0:15871:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179023 00010000:00010000:1.0:1721219354.394023:0:25696:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.394027:0:25696:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.394032:0:25696:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6ac0 already unused, calling callback (ffffffffa0815190) 00010000:00010000:1.0:1721219354.394034:0:25696:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.394040:0:25696:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219354.394046:0:25696:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219354.394052:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf176c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459592256:0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219354.394053:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721219354.394068:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf17200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459592064:0@lo:103:ldlm_bl_04.0 00000100:00100000:1.0:1721219354.394079:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137123dc0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:2851:x1804827459592448:12345-0@lo:103:ldlm_bl_01.0 Request processed in 127us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219354.394082:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459592320:0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219354.394085:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179026 00000100:00100000:0.0:1721219354.394090:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137124c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459592384:0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1721219354.394100:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459592128:0@lo:103:ldlm_bl_03.0 00000100:00100000:1.0:1721219354.394119:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae56d40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459592448:0@lo:103:ldlm_bl_01.0 00010000:00010000:2.0:1721219354.394128:0:14240:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5451f80/0xd4836d281e0019bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b08 expref: 8 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:1.0:1721219354.394129:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae54740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459592192:0@lo:103:ldlm_bl_01.0 00000100:00100000:2.0:1721219354.394144:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6b900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591488:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219354.394157:0:14240:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e4000/0xd4836d281e0019b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b01 expref: 7 pid: 27118 timeout: 1900 lvb_type: 0 00000100:00100000:2.0:1721219354.394169:0:14240:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf6e880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14240:1804827459591552:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219354.394220:0:14240:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.394231:0:14240:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.394238:0:14240:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219354.394245:0:14240:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e6ac0/0xd4836d281e0019c3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14240 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.155698:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219355.325534:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219355.325564:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219355.325586:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219355.325621:0:15809:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266240 00000100:00100000:3.0:1721219355.325641:0:27124:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266176 00000100:00100000:2.0:1721219355.325684:0:15809:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266304 00000100:00100000:3.0:1721219355.325690:0:27124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 653 00000100:00100000:3.0:1721219355.325693:0:27124:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:1836:x1804827511266176:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:1.0:1721219355.325704:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 904 00010000:00000080:3.0:1721219355.325714:0:27124:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee92f80 x1804827511266176/t0(0) o400->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:645/0 lens 224/224 e 0 to 0 dl 1721219445 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:1.0:1721219355.325716:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511266240:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219355.325717:0:15809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 905 00000100:00100000:2.0:1721219355.325723:0:15809:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee963c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1836:x1804827511266304:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219355.325748:0:27124:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:1836:x1804827511266176:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 54us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.325753:0:27124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 653 00000100:00100000:2.0:1721219355.325789:0:15809:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee963c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1836:x1804827511266304:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 65us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219355.325797:0:15809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 905 00000100:00100000:1.0:1721219355.325797:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511266240:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 81us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219355.325824:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 904 00000100:00100000:0.0:1721219355.597891:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.598022:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266368 00000100:00100000:3.0:1721219355.598073:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1017 00000100:00100000:3.0:1721219355.598079:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:4616:x1804827511266368:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219355.598093:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219355.598123:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b0f expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.598152:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.598163:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.598172:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a54518c0, rc 0) 00000100:00100000:3.0:1721219355.598218:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511266368:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 138us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.598225:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1017 00000100:00100000:0.0:1721219355.599391:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.599540:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266432 00000100:00100000:3.0:1721219355.599575:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1018 00000100:00100000:3.0:1721219355.599580:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511266432:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219355.599701:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511266432:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 119us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.599708:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1018 00000100:00100000:0.0:1721219355.601158:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.601285:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266496 00000100:00100000:3.0:1721219355.601330:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1019 00000100:00100000:3.0:1721219355.601336:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511266496:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219355.601662:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511266496:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 309us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.601671:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1019 00000100:00100000:0.0:1721219355.603368:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.603491:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266560 00000100:00100000:3.0:1721219355.603552:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1020 00000100:00100000:3.0:1721219355.603565:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22846:x1804827511266560:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219355.603895:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22846:x1804827511266560:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 329us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.603903:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1020 00000100:00100000:0.0:1721219355.605322:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.605428:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266624 00000100:00100000:3.0:1721219355.605466:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1021 00000100:00100000:3.0:1721219355.605491:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22846:x1804827511266624:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1721219355.605717:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:22846:x1804827511266624:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 224us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.605725:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1021 00000100:00100000:0.0:1721219355.607261:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.607361:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266688 00000100:00100000:3.0:1721219355.607399:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1022 00000100:00100000:3.0:1721219355.607404:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511266688:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219355.607413:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219355.607422:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b16 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.607439:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 9 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.607447:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 9 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219355.607453:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5451680, rc 0) 00000100:00100000:3.0:1721219355.607525:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511266688:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 120us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.607543:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1022 00000100:00100000:0.0:1721219355.608602:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219355.608704:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266752 00000100:00100000:3.0:1721219355.608743:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1023 00000100:00100000:3.0:1721219355.608748:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511266752:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219355.608815:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511266752:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 66us (217us total) trans 0 rc -2/-2 00000100:00100000:3.0:1721219355.608823:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1023 00000100:00100000:2.0:1721219355.843783:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee904c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459592512:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219355.843785:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2851:1804827459592704:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219355.843822:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2849:1804827459592576:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721219355.843830:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2850:1804827459592640:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219355.843859:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219355.843866:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219355.843901:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219355.843902:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219355.843907:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee91c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459592768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219355.843925:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2850:1804827459592896:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219355.843926:0:27124:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592704 00000100:00100000:3.0:1721219355.843928:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2849:1804827459592832:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219355.843936:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219355.843950:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219355.843952:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219355.843962:0:27124:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592640 00000100:00100000:1.0:1721219355.843974:0:27124:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592896 00000100:00100000:2.0:1721219355.843979:0:28689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 654 00000100:00100000:2.0:1721219355.843986:0:28689:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801371276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2851:x1804827459592704:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219355.843991:0:27125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 655 00000100:00100000:3.0:1721219355.843992:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592512 00000100:00100000:1.0:1721219355.843998:0:27124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 656 00000100:00100000:0.0:1721219355.843999:0:27125:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee95f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2850:x1804827459592640:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219355.844004:0:27124:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee917c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2850:x1804827459592896:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:2.0:1721219355.844006:0:28689:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8801371276c0 x1804827459592704/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:645/0 lens 224/224 e 0 to 0 dl 1721219445 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:3.0:1721219355.844015:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1024 00010000:00000080:0.0:1721219355.844017:0:27125:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee95f00 x1804827459592640/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:645/0 lens 224/224 e 0 to 0 dl 1721219445 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00010000:00000080:1.0:1721219355.844019:0:27124:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee917c0 x1804827459592896/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:645/0 lens 224/224 e 0 to 0 dl 1721219445 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:3.0:1721219355.844020:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:2852:x1804827459592512:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219355.844056:0:28689:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801371276c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2851:x1804827459592704:12345-0@lo:400:kworker/u8:1.0 Request processed in 71us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219355.844063:0:28689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 654 00000100:00100000:0.0:1721219355.844069:0:27125:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee95f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:2850:x1804827459592640:12345-0@lo:400:kworker/u8:1.0 Request processed in 72us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219355.844071:0:27124:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee917c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:2850:x1804827459592896:12345-0@lo:400:kworker/u8:1.0 Request processed in 67us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.844075:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:2852:x1804827459592512:12345-0@lo:400:kworker/u8:1.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219355.844075:0:27125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 655 00000100:00100000:1.0:1721219355.844079:0:27124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 656 00000100:00100000:3.0:1721219355.844081:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1024 00000100:00100000:2.0:1721219355.844091:0:15809:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592768 00000100:00100000:0.0:1721219355.844095:0:8328:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592576 00000100:00100000:1.0:1721219355.844102:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592832 00000100:00100000:3.0:1721219355.844124:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee904c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459592512:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219355.844127:0:15809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 906 00000100:00100000:2.0:1721219355.844132:0:15809:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:2852:x1804827459592768:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219355.844133:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 907 00000100:00100000:0.0:1721219355.844133:0:8328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00000100:00100000:0.0:1721219355.844137:0:8328:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae50980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2849:x1804827459592576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721219355.844138:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae51c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2849:x1804827459592832:12345-0@lo:400:kworker/u8:1.0 00002000:00000024:0.0:1721219355.844163:0:8328:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 511770624 pending 0 free 3458203648 avail 3456106496 00000100:00100000:2.0:1721219355.844165:0:15809:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf15580 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+6:2852:x1804827459592768:12345-0@lo:400:kworker/u8:1.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219355.844174:0:15809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 906 00000100:00100000:1.0:1721219355.844175:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae51c80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2849:x1804827459592832:12345-0@lo:400:kworker/u8:1.0 Request processed in 35us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219355.844181:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2849:1804827459592832:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219355.844188:0:8328:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae50980 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2849:x1804827459592576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 52us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219355.844193:0:8328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1721219355.844197:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 907 00000100:00100000:3.0:1721219355.844200:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:2849:1804827459592576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721219355.844221:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee91c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459592768:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219355.844226:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee93dc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:2850:1804827459592640:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219355.844230:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee90e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:2851:1804827459592704:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219355.844245:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:2850:1804827459592896:0@lo:400:kworker/u8:1.0 10000000:01000000:3.0:1721219356.025604:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1721219356.025618:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a6512800 from 115 10000000:01000000:3.0:1721219356.025623:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1721219356.025648:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.025658:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.025667:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219356.025698:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459592960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.025721:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.025738:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800908db780 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.025809:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459592960 00000100:00100000:1.0:1721219356.025839:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1025 00000100:00100000:1.0:1721219356.025842:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:6729:x1804827459592960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219356.025849:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219356.025861:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0019d8 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219356.025884:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 12 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219356.025889:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 12 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219356.025894:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd221c0, rc 0) 00000100:00100000:1.0:1721219356.025918:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459592960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.025922:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1025 00000100:00100000:3.0:1721219356.025927:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459592960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219356.025937:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.025943:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219356.025975:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.025993:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.026008:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800908db780 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.026024:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593024 00000100:00100000:1.0:1721219356.026035:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1026 00000100:00100000:1.0:1721219356.026037:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459593024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.026132:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459593024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.026136:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1026 00000100:00100000:3.0:1721219356.026167:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.026193:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.026234:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.026257:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800908db780 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.026269:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593088 00000100:00100000:1.0:1721219356.026280:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1027 00000100:00100000:1.0:1721219356.026282:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459593088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.026430:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459593088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.026434:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1027 00000100:00100000:3.0:1721219356.026451:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.026655:0:14270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14270:1804827459593152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.026684:0:14270:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.026698:0:14270:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800908db780 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.026715:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593152 00000100:00100000:1.0:1721219356.026727:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1028 00000100:00100000:1.0:1721219356.026729:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14270:x1804827459593152:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.026925:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14270:x1804827459593152:12345-0@lo:502:llog_process_th.0 Request processed in 194us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.026932:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1028 00000100:00100000:3.0:1721219356.026946:0:14270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14270:1804827459593152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.026978:0:14270:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14270:1804827459593216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.027001:0:14270:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.027008:0:14270:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800908db780 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.027012:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593216 00000100:00100000:1.0:1721219356.027022:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1029 00000100:00100000:1.0:1721219356.027024:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14270:x1804827459593216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.027128:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:14270:x1804827459593216:12345-0@lo:502:llog_process_th.0 Request processed in 103us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.027132:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1029 00000100:00100000:3.0:1721219356.027136:0:14270:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14270:1804827459593216:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1721219356.027152:0:14270:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 118 count 117 00000020:01000000:0.0:1721219356.027236:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 115-117 (rc=0) 10000000:01000000:0.0:1721219356.027256:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219356.027260:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.027266:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219356.027272:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1721219356.027274:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 111 10000000:01000000:0.0:1721219356.027275:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1721219356.027286:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.027290:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.027295:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219356.027303:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.027327:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.027337:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.027340:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593280 00000100:00100000:1.0:1721219356.027353:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1030 00000100:00100000:1.0:1721219356.027355:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459593280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219356.027359:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:1.0:1721219356.027363:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0019e6 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219356.027370:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 13 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219356.027373:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 13 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219356.027377:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008cd20000, rc 0) 00000100:00100000:1.0:1721219356.027398:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459593280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 42us (72us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.027401:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1030 00000100:00100000:0.0:1721219356.027424:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219356.027432:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.027437:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219356.027493:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.027531:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.027539:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.027544:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593344 00000100:00100000:1.0:1721219356.027558:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1031 00000100:00100000:1.0:1721219356.027560:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459593344:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.027606:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459593344:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 45us (75us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.027609:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1031 00000100:00100000:0.0:1721219356.027615:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593344:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.027633:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.027658:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.027665:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:1.0:1721219356.027669:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593408 00000100:00100000:1.0:1721219356.027678:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1032 00000100:00100000:1.0:1721219356.027679:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459593408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.027790:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459593408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 110us (132us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219356.027794:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1032 00000100:00100000:0.0:1721219356.027813:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.027967:0:14271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14271:1804827459593472:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.027988:0:14271:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219356.028001:0:14271:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62fd0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219356.028016:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593472 00000100:00100000:2.0:1721219356.028036:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1033 00000100:00100000:2.0:1721219356.028039:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14271:x1804827459593472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219356.028253:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14271:x1804827459593472:12345-0@lo:502:llog_process_th.0 Request processed in 213us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219356.028260:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1033 00000100:00100000:1.0:1721219356.028267:0:14271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14271:1804827459593472:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1721219356.028285:0:14271:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219356.028291:0:14271:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219356.028292:0:14271:0:(obd_config.c:1460:class_process_config()) marker 73 (0x1) lustre-MDT0000-m del lustre.test_22c 00000020:00000080:1.0:1721219356.028296:0:14271:0:(obd_config.c:1384:class_process_config()) processing cmd: ce023 00000100:00100000:1.0:1721219356.028942:0:14271:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14271:1804827459593536:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.028963:0:14271:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219356.028976:0:14271:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a62fd0c0 going to sleep for 6 seconds 00000100:00100000:2.0:1721219356.029034:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593536 00000100:00100000:2.0:1721219356.029058:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1034 00000100:00100000:2.0:1721219356.029060:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14271:x1804827459593536:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219356.029212:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:14271:x1804827459593536:12345-0@lo:502:llog_process_th.0 Request processed in 150us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219356.029219:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1034 00000100:00100000:1.0:1721219356.029222:0:14271:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14271:1804827459593536:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1721219356.029235:0:14271:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219356.029237:0:14271:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219356.029238:0:14271:0:(obd_config.c:1460:class_process_config()) marker 73 (0x2) lustre-MDT0000-m del lustre.test_22c 00000040:00080000:1.0:1721219356.029240:0:14271:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 114 count 112 00000020:01000000:0.0:1721219356.029324:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 111-113 (rc=0) 10000000:01000000:0.0:1721219356.029339:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1721219356.029342:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.029348:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219356.029355:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219356.029356:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880136319800 from 115 10000000:01000000:0.0:1721219356.029357:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219356.029369:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.029374:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.029379:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219356.029396:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.029420:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.029441:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:2.0:1721219356.029455:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593600 00000100:00100000:2.0:1721219356.029507:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1035 00000100:00100000:2.0:1721219356.029509:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459593600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219356.029514:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219356.029519:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e0019f4 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.029528:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 14 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.029533:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 14 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.029536:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e61c0, rc 0) 00000100:00100000:2.0:1721219356.029560:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459593600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 50us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219356.029564:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1035 00000100:00100000:0.0:1721219356.029572:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219356.029580:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.029585:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219356.029609:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.029625:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.029632:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:2.0:1721219356.029638:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593664 00000100:00100000:2.0:1721219356.029652:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1036 00000100:00100000:2.0:1721219356.029654:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459593664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.029696:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459593664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 41us (71us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219356.029700:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1036 00000100:00100000:0.0:1721219356.029706:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.029719:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.029746:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.029753:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.029760:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593728 00000100:00100000:3.0:1721219356.029788:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1037 00000100:00100000:3.0:1721219356.029791:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459593728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.029924:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459593728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.029929:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1037 00000100:00100000:0.0:1721219356.029989:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.030168:0:14272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14272:1804827459593792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.030200:0:14272:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219356.030227:0:14272:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b5246240 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.030266:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593792 00000100:00100000:3.0:1721219356.030297:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1038 00000100:00100000:3.0:1721219356.030301:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14272:x1804827459593792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.030692:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14272:x1804827459593792:12345-0@lo:502:llog_process_th.0 Request processed in 390us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.030701:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1038 00000100:00100000:1.0:1721219356.030753:0:14272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14272:1804827459593792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.030784:0:14272:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14272:1804827459593856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219356.030807:0:14272:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219356.030825:0:14272:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b5246240 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.030872:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593856 00000100:00100000:3.0:1721219356.030892:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1039 00000100:00100000:3.0:1721219356.030895:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14272:x1804827459593856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.031055:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:14272:x1804827459593856:12345-0@lo:502:llog_process_th.0 Request processed in 159us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.031060:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1039 00000100:00100000:1.0:1721219356.031073:0:14272:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14272:1804827459593856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219356.031089:0:14272:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 118 count 117 00000020:01000000:0.0:1721219356.031173:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 115-117 (rc=0) 10000000:01000000:0.0:1721219356.031188:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219356.031190:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.031197:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219356.031212:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1721219356.031213:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1721219356.031215:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1721219356.031227:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.031231:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.031237:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219356.031245:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.031269:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219356.031290:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.031303:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593920 00000100:00100000:3.0:1721219356.031322:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1040 00000100:00100000:3.0:1721219356.031324:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459593920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219356.031329:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219356.031336:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a02 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.031347:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a02 expref: 15 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.031352:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a02 expref: 15 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.031357:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a54521c0, rc 0) 00000100:00100000:3.0:1721219356.031381:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459593920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 56us (113us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.031385:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1040 00000100:00100000:0.0:1721219356.031407:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219356.031415:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.031421:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219356.031444:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.031461:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.031487:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459593984 00000100:00100000:0.0:1721219356.031507:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880132f0b840 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.031514:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1041 00000100:00100000:3.0:1721219356.031517:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459593984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.031572:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459593984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 54us (111us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.031577:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1041 00000100:00100000:1.0:1721219356.031592:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459593984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.031613:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219356.031643:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219356.031651:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b5246240 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.031657:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594048 00000100:00100000:3.0:1721219356.031682:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1042 00000100:00100000:3.0:1721219356.031685:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459594048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.031830:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459594048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 145us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.031836:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1042 00000100:00100000:1.0:1721219356.031851:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594048:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1721219356.032231:0:14273:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1721219356.032260:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1721219356.032275:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1721219356.032289:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.032294:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219356.032300:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219356.032301:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009928e000 from 115 10000000:01000000:2.0:1721219356.032303:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219356.032313:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.032316:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.032320:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219356.032328:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.032351:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.032369:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.032433:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594112 00000100:00100000:3.0:1721219356.032454:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1043 00000100:00100000:3.0:1721219356.032458:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459594112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219356.032464:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219356.032490:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a10 expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.032519:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a10 expref: 16 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.032525:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a10 expref: 16 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219356.032529:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5453cc0, rc 0) 00000100:00100000:3.0:1721219356.032555:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459594112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 97us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.032560:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1043 00000100:00100000:2.0:1721219356.032574:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219356.032584:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.032591:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219356.032623:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.032646:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.032663:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.032685:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594176 00000100:00100000:3.0:1721219356.032699:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1044 00000100:00100000:3.0:1721219356.032702:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459594176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.032755:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459594176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 52us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.032759:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1044 00000100:00100000:2.0:1721219356.032768:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.032786:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.032816:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.032824:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:3.0:1721219356.032831:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594240 00000100:00100000:3.0:1721219356.032842:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1045 00000100:00100000:3.0:1721219356.032844:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459594240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.032947:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459594240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219356.032952:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1045 00000100:00100000:2.0:1721219356.032954:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219356.033168:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14274:1804827459594304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.033211:0:14274:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.033239:0:14274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4dbc0c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.033267:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594304 00000100:00100000:0.0:1721219356.033299:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1046 00000100:00100000:0.0:1721219356.033305:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14274:x1804827459594304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219356.033692:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14274:x1804827459594304:12345-0@lo:502:llog_process_th.0 Request processed in 385us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219356.033700:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1046 00000100:00100000:3.0:1721219356.033799:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14274:1804827459594304:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.033852:0:14274:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14274:1804827459594368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219356.033895:0:14274:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219356.033926:0:14274:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b4dbc0c0 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.033952:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594368 00000100:00100000:0.0:1721219356.033993:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1047 00000100:00100000:0.0:1721219356.033996:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14274:x1804827459594368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219356.034157:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:14274:x1804827459594368:12345-0@lo:502:llog_process_th.0 Request processed in 160us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219356.034163:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1047 00000100:00100000:3.0:1721219356.034180:0:14274:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:14274:1804827459594368:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1721219356.034199:0:14274:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 118 count 117 00000020:01000000:2.0:1721219356.034244:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 115-117 (rc=0) 10000000:01000000:2.0:1721219356.034257:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219356.034260:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.034265:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219356.034269:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1721219356.034271:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1721219356.034276:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1721219356.034287:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.034290:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.034294:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219356.034301:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.034321:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.034329:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.034334:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594432 00000100:00100000:0.0:1721219356.034347:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1048 00000100:00100000:0.0:1721219356.034349:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459594432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219356.034355:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219356.034361:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a1e expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.034372:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a1e expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.034378:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a1e expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.034383:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0cd80, rc 0) 00000100:00100000:0.0:1721219356.034403:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459594432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 53us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219356.034407:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1048 00000100:00100000:2.0:1721219356.034411:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219356.034417:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.034420:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219356.034441:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.034454:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.034460:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.034466:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594496 00000100:00100000:0.0:1721219356.034520:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1049 00000100:00100000:0.0:1721219356.034523:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459594496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.034578:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459594496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 55us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219356.034582:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1049 00000100:00100000:2.0:1721219356.034585:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.034602:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.034634:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.034643:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.034648:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594560 00000100:00100000:0.0:1721219356.034658:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1050 00000100:00100000:0.0:1721219356.034660:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459594560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.034794:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459594560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219356.034799:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1050 00000100:00100000:2.0:1721219356.034811:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1721219356.035586:0:14275:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:2.0:1721219356.035652:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1721219356.035667:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1721219356.035669:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.035675:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219356.035680:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219356.035682:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6c10000 from 1 10000000:01000000:2.0:1721219356.035683:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219356.035695:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.035699:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.035705:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219356.035716:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.035741:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.035762:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.035863:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594624 00000100:00100000:0.0:1721219356.035910:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1051 00000100:00100000:0.0:1721219356.035915:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459594624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219356.035925:0:27118:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219356.035935:0:27118:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a2c expref: -99 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.035952:0:27118:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a2c expref: 18 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.035961:0:27118:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a2c expref: 18 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.035967:0:27118:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0d200, rc 0) 00000100:00100000:0.0:1721219356.036008:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459594624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219356.036014:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.036015:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1051 00010000:00010000:2.0:1721219356.036022:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.036026:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219356.036057:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219356.036073:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219356.036081:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff880133aab600 going to sleep for 6 seconds 00000100:00100000:0.0:1721219356.036094:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594688 00000100:00100000:0.0:1721219356.036128:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1052 00000100:00100000:0.0:1721219356.036130:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459594688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219356.036177:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459594688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 46us (103us total) trans 0 rc -2/-2 00000100:00100000:0.0:1721219356.036181:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1052 00000100:00100000:2.0:1721219356.036183:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf11c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459594688:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1721219356.036195:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1721219356.036197:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219356.036200:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219356.157668:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219357.159617:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219358.161616:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000400:00000080:1.0:1721219359.007299:0:14758:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219359.007304:0:14758:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pfl test 22d: out of/low on space + failed to repeat + forced extension ========================================================== 08:29:17 (1721219357) 00000100:00100000:0.0:1721219359.029827:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219359.029971:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266816 00000100:00100000:2.0:1721219359.030041:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 345 00000100:00100000:2.0:1721219359.030048:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee93dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:22998:x1804827511266816:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1721219359.030068:0:30055:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219359.030087:0:30055:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001a3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b1d expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030144:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030158:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030169:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030198:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030204:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030211:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030296:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030303:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030309:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030315:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e4000 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219359.030318:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030325:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030335:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008ea0ce00) 00010000:00010000:2.0:1721219359.030338:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219359.030341:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030357:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030369:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030374:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030380:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030385:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e46c0 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219359.030387:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030392:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030399:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9516acfe (ffff8801333d7700) 00010000:00010000:2.0:1721219359.030401:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219359.030402:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030407:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e46c0/0xd4836d281e001a48 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030504:0:30055:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001a3a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b1d expref: 64 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030526:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001a3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b1d expref: 64 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219359.030537:0:30055:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5d40, rc 0) 00010000:00000080:2.0:1721219359.030543:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee93dc0 x1804827511266816/t0(0) o101->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:649/0 lens 584/640 e 0 to 0 dl 1721219449 ref 1 fl Interpret:/0/0 rc 301/0 job:'bash.0' 00000100:00100000:2.0:1721219359.030625:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee93dc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:22998:x1804827511266816:12345-192.168.201.58@tcp:101:bash.0 Request processed in 577us (800us total) trans 0 rc 301/301 00000100:00100000:2.0:1721219359.030634:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 345 00000100:00100000:2.0:1721219359.031682:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219359.031774:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266880 00000100:00100000:3.0:1721219359.031812:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 346 00000100:00100000:3.0:1721219359.031816:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:22998:x1804827511266880:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1721219359.031829:0:30055:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219359.031843:0:30055:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451f80/0xd4836d281e001a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b24 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.031883:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451200/0xd4836d281e001a56 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.031897:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451200/0xd4836d281e001a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.031905:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451200/0xd4836d281e001a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000004:00200000:3.0:1721219359.031960:0:30055:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 13824 00000004:00200000:3.0:1721219359.031963:0:30055:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 48 stripe count 1 MDT count 1 00000004:00010000:3.0:1721219359.031975:0:30055:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451200/0xd4836d281e001a56 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.031989:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451f80/0xd4836d281e001a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b24 expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.031999:0:30055:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451200/0xd4836d281e001a56 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b24 expref: 64 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.032004:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008ea0ce00) 00010000:00010000:3.0:1721219359.032006:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1721219359.032008:0:30055:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5451200, rc 0) 00010000:00000080:3.0:1721219359.032011:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008bf11c80 x1804827511266880/t0(0) o101->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:649/0 lens 576/688 e 0 to 0 dl 1721219449 ref 1 fl Interpret:/0/0 rc 0/0 job:'bash.0' 00000100:00100000:3.0:1721219359.032065:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf11c80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:22998:x1804827511266880:12345-192.168.201.58@tcp:101:bash.0 Request processed in 250us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219359.032070:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 346 00000100:00100000:0.0:1721219359.035096:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219359.035154:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1721219359.035174:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511266944 00000100:00100000:1.0:1721219359.035187:0:27341:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267072 00000100:00100000:3.0:1721219359.035202:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 347 00000100:00100000:3.0:1721219359.035206:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee92140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+65:1834:x1804827511266944:12345-192.168.201.58@tcp:41:mkdir.0 00000100:00100000:1.0:1721219359.035234:0:27341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 348 00000004:00000024:3.0:1721219359.035238:0:30055:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 0 granted 8257536 pending 0 free 2257321984 avail 2255224832 00000100:00100000:1.0:1721219359.035239:0:27341:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2df8dc7e-94ba-4991-a575-93aaf526cb45+65:23158:x1804827511267072:12345-192.168.201.58@tcp:36:mkdir.0 00010000:00000080:3.0:1721219359.035251:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee92140 x1804827511266944/t0(0) o41->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:649/0 lens 224/368 e 0 to 0 dl 1721219449 ref 1 fl Interpret:/0/0 rc 0/0 job:'mkdir.0' 00010000:00010000:1.0:1721219359.035267:0:27341:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721219359.035273:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee92140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+65:1834:x1804827511266944:12345-192.168.201.58@tcp:41:mkdir.0 Request processed in 67us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219359.035279:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 347 00010000:00010000:1.0:1721219359.035283:0:27341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a5451200/0xd4836d281e001a56 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b24 expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.035309:0:27341:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008ea0ce00) 00010000:00010000:1.0:1721219359.035312:0:27341:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219359.035372:0:27341:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.035381:0:27341:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.035388:0:27341:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.035397:0:27341:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.035403:0:27341:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.035408:0:27341:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00000004:00200000:1.0:1721219359.036092:0:27341:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6a19:0x0]: returning size 512 00010000:00010000:1.0:1721219359.036099:0:27341:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.036106:0:27341:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.036111:0:27341:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.036125:0:27341:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cd23180 already unused, calling callback (ffffffffa1356360) 00010000:00010000:1.0:1721219359.036128:0:27341:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.036133:0:27341:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.036141:0:27341:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008ea0ce00) 00010000:00010000:1.0:1721219359.036143:0:27341:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1721219359.036145:0:27341:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219359.036149:0:27341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd23180/0xd4836d281e001a5d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00000004:00010000:1.0:1721219359.036157:0:27341:0:(mdt_handler.c:3997:mdt_save_lock()) ### save lock request ffff88008ee95a40 reply state ffff88008be45c00 transno 12884902031 ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00000080:1.0:1721219359.036200:0:27341:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee95a40 x1804827511267072/t12884902031(0) o36->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:649/0 lens 512/448 e 0 to 0 dl 1721219449 ref 1 fl Interpret:/0/0 rc 0/0 job:'mkdir.0' 00000100:00100000:1.0:1721219359.036262:0:27341:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee95a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2df8dc7e-94ba-4991-a575-93aaf526cb45+65:23158:x1804827511267072:12345-192.168.201.58@tcp:36:mkdir.0 Request processed in 1021us (1107us total) trans 12884902031 rc 0/0 00000100:00100000:1.0:1721219359.036271:0:27341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 348 00010000:00010000:3.0:1721219359.036926:0:2836:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.036934:0:2836:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.036939:0:2836:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.036942:0:2836:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cd21200 already unused, calling callback (ffffffffa1356360) 00010000:00010000:3.0:1721219359.036944:0:2836:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.036948:0:2836:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.036955:0:2836:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9516acfe (ffff8800834a4700) 00010000:00010000:3.0:1721219359.036956:0:2836:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1721219359.036958:0:2836:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.036961:0:2836:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008cd21200/0xd4836d281e001a64 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 27341 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219359.163650:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219360.165763:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219360.334002:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219360.334064:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219360.334121:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219360.334126:0:27341:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267200 00000100:00100000:1.0:1721219360.334187:0:27341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 657 00000100:00100000:0.0:1721219360.334194:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219360.334196:0:27341:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee90980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:1837:x1804827511267200:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219360.334207:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267136 00010000:00000080:1.0:1721219360.334235:0:27341:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ee90980 x1804827511267200/t0(0) o400->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:650/0 lens 224/224 e 0 to 0 dl 1721219450 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:0.0:1721219360.334248:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267264 00000100:00100000:2.0:1721219360.334249:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1053 00000100:00100000:2.0:1721219360.334255:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1836:x1804827511267136:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219360.334265:0:15816:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267328 00000100:00100000:0.0:1721219360.334292:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 908 00000100:00100000:0.0:1721219360.334300:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee94740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511267264:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219360.334303:0:15816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 909 00000100:00100000:3.0:1721219360.334309:0:15816:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ee90e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1837:x1804827511267328:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219360.334311:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1836:x1804827511267136:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 56us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219360.334319:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1053 00000100:00100000:1.0:1721219360.334319:0:27341:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee90980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:1837:x1804827511267200:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 122us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219360.334332:0:27341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 657 00000100:00100000:0.0:1721219360.334352:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee94740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511267264:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 51us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219360.334364:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 908 00000100:00100000:3.0:1721219360.334365:0:15816:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ee90e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1837:x1804827511267328:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 55us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219360.334373:0:15816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 909 00000001:00080000:3.0:1721219360.480494:0:27193:0:(tgt_lastrcvd.c:926:tgt_cb_last_committed()) lustre-MDT0000: transno 12884902031 is committed 00000100:00100000:3.0:1721219360.851705:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee94c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2849:1804827459594880:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219360.851774:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219360.851782:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459594752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721219360.851809:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2849:1804827459595136:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219360.851825:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee904c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2850:1804827459594944:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219360.851830:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219360.851831:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219360.851855:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459595008:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219360.851868:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ee91c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459594816:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219360.851871:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219360.851875:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219360.851895:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219360.851902:0:27341:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594880 00000100:00100000:3.0:1721219360.851908:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459595072:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219360.851917:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595136 00000100:00100000:3.0:1721219360.851923:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219360.851931:0:27124:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594944 00000100:00100000:2.0:1721219360.851948:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 658 00000100:00100000:3.0:1721219360.851950:0:15816:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595008 00000100:00100000:2.0:1721219360.851953:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae56d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2849:x1804827459595136:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219360.851966:0:27341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 659 00000100:00100000:1.0:1721219360.851973:0:27124:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 660 00000100:00100000:0.0:1721219360.851974:0:27341:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae54740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2849:x1804827459594880:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:2.0:1721219360.851975:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ae56d40 x1804827459595136/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:650/0 lens 224/224 e 0 to 0 dl 1721219450 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:3.0:1721219360.851976:0:15816:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595072 00000100:00100000:1.0:1721219360.851977:0:27124:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137121300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2850:x1804827459594944:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219360.851989:0:15816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 910 00010000:00000080:1.0:1721219360.851993:0:27124:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880137121300 x1804827459594944/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:650/0 lens 224/224 e 0 to 0 dl 1721219450 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:3.0:1721219360.851994:0:15816:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459595008:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1721219360.851995:0:27341:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008ae54740 x1804827459594880/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:650/0 lens 224/224 e 0 to 0 dl 1721219450 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1721219360.852042:0:27124:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137121300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:2850:x1804827459594944:12345-0@lo:400:kworker/u8:1.0 Request processed in 65us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219360.852044:0:15816:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf12600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459595008:12345-0@lo:400:kworker/u8:1.0 Request processed in 49us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219360.852045:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae56d40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2849:x1804827459595136:12345-0@lo:400:kworker/u8:1.0 Request processed in 92us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219360.852052:0:15816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 910 00000100:00100000:1.0:1721219360.852052:0:27124:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 660 00000100:00100000:2.0:1721219360.852067:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 658 00000100:00100000:0.0:1721219360.852072:0:27341:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae54740 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:2849:x1804827459594880:12345-0@lo:400:kworker/u8:1.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219360.852077:0:15816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 911 00000100:00100000:3.0:1721219360.852080:0:15816:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:2852:x1804827459595072:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219360.852083:0:27341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 659 00000100:00100000:2.0:1721219360.852096:0:8328:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594752 00000100:00100000:1.0:1721219360.852105:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee904c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2850:1804827459594944:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219360.852110:0:15816:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53440 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:lustre-MDT0000-mdtlov_UUID+5:2852:x1804827459595072:12345-0@lo:400:kworker/u8:1.0 Request processed in 29us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219360.852116:0:15816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 911 00000100:00100000:2.0:1721219360.852117:0:8328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1721219360.852120:0:8328:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459594752:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721219360.852141:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459594816 00000100:00100000:3.0:1721219360.852143:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459595072:0@lo:400:kworker/u8:1.0 00002000:00000024:2.0:1721219360.852148:0:8328:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 511770624 pending 0 free 3458203648 avail 3456106496 00000100:00100000:3.0:1721219360.852164:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2849:1804827459595136:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219360.852172:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1721219360.852173:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee94c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2849:1804827459594880:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219360.852177:0:8328:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf17200 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459594752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219360.852178:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2852:x1804827459594816:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219360.852183:0:8328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:2.0:1721219360.852216:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ae55a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459594752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721219360.852224:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2852:x1804827459594816:12345-0@lo:400:kworker/u8:1.0 Request processed in 45us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219360.852225:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459595008:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219360.852235:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1054 00000100:00100000:3.0:1721219360.852241:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ee91c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459594816:0@lo:400:kworker/u8:1.0 00010000:00010000:0.0:1721219361.167676:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219362.169628:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219363.171666:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219364.173599:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219365.175692:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219365.342007:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219365.342061:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219365.342093:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219365.342141:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219365.342155:0:28689:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267456 00000100:00100000:0.0:1721219365.342182:0:15816:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267520 00000100:00100000:2.0:1721219365.342207:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267392 00000100:00100000:0.0:1721219365.342210:0:15816:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267584 00000100:00100000:1.0:1721219365.342211:0:28689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 661 00000100:00100000:1.0:1721219365.342217:0:28689:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:1837:x1804827511267456:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219365.342227:0:15816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 912 00000100:00100000:0.0:1721219365.342233:0:15816:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511267520:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00010000:00000080:1.0:1721219365.342249:0:28689:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880098f60980 x1804827511267456/t0(0) o400->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:655/0 lens 224/224 e 0 to 0 dl 1721219455 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1721219365.342252:0:14647:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 913 00000100:00100000:3.0:1721219365.342261:0:14647:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f62ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1837:x1804827511267584:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:2.0:1721219365.342262:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1055 00000100:00100000:2.0:1721219365.342271:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1836:x1804827511267392:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219365.342290:0:15816:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f60e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1836:x1804827511267520:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 57us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219365.342299:0:28689:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f60980 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:1837:x1804827511267456:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 82us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219365.342299:0:15816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 912 00000100:00100000:1.0:1721219365.342308:0:28689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 661 00000100:00100000:3.0:1721219365.342309:0:14647:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f62ac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1837:x1804827511267584:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 49us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219365.342317:0:14647:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 913 00000100:00100000:2.0:1721219365.342326:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1836:x1804827511267392:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 55us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219365.342338:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1055 00000100:00100000:2.0:1721219365.859649:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2849:1804827459595392:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219365.859673:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2852:1804827459595328:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219365.859683:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459595264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721219365.859704:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459595200:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219365.859715:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219365.859750:0:28689:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595392 00000100:00100000:3.0:1721219365.859753:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219365.859772:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219365.859780:0:8328:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595264 00000100:00100000:3.0:1721219365.859784:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7aa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459595520:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219365.859787:0:28689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1721219365.859797:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2850:1804827459595456:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219365.859802:0:28689:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2849:x1804827459595392:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219365.859807:0:8328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:2.0:1721219365.859811:0:8328:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459595264:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1721219365.859817:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00000080:0.0:1721219365.859822:0:28689:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008bf12ac0 x1804827459595392/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:655/0 lens 224/224 e 0 to 0 dl 1721219455 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1721219365.859845:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:2.0:1721219365.859856:0:8328:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 511770624 pending 0 free 3458203648 avail 3456106496 00000100:00100000:0.0:1721219365.859867:0:28689:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf12ac0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:2849:x1804827459595392:12345-0@lo:400:kworker/u8:1.0 Request processed in 66us (153us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219365.859868:0:14647:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595520 00000100:00100000:0.0:1721219365.859875:0:28689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 662 00000100:00100000:1.0:1721219365.859877:0:15809:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595456 00000100:00100000:2.0:1721219365.859895:0:8328:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae53900 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2851:x1804827459595264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219365.859903:0:8328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00000100:00100000:3.0:1721219365.859904:0:14647:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 914 00000100:00100000:3.0:1721219365.859911:0:14647:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008ae55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459595520:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219365.859914:0:15809:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 915 00000100:00100000:1.0:1721219365.859919:0:15809:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137124740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:2850:x1804827459595456:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219365.859928:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595200 00000100:00100000:0.0:1721219365.859939:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219365.859948:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1056 00000100:00100000:2.0:1721219365.859951:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2850:x1804827459595200:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219365.859958:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88009c7a97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2852:1804827459595584:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219365.859963:0:15809:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137124740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_010:lustre-MDT0000-mdtlov_UUID+5:2850:x1804827459595456:12345-0@lo:400:kworker/u8:1.0 Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219365.859970:0:15809:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 915 00000100:00100000:3.0:1721219365.859980:0:14647:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008ae55a40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459595520:12345-0@lo:400:kworker/u8:1.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219365.859983:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2850:x1804827459595200:12345-0@lo:400:kworker/u8:1.0 Request processed in 31us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219365.859985:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219365.859988:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1056 00000100:00100000:3.0:1721219365.859992:0:14647:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 914 00000100:00100000:1.0:1721219365.860003:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459595200:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219365.860013:0:28689:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595328 00000100:00100000:1.0:1721219365.860015:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:2850:1804827459595456:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219365.860021:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:2849:1804827459595392:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219365.860039:0:28689:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595584 00000100:00100000:0.0:1721219365.860053:0:28689:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 663 00000100:00100000:0.0:1721219365.860057:0:28689:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1804827459595328:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219365.860059:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459595264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721219365.860062:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 664 00000100:00100000:2.0:1721219365.860066:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1804827459595584:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:0.0:1721219365.860068:0:28689:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bc8000 x1804827459595328/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:655/0 lens 224/224 e 0 to 0 dl 1721219455 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:3.0:1721219365.860075:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c7aa140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459595520:0@lo:400:kworker/u8:1.0 00010000:00000080:2.0:1721219365.860077:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bc84c0 x1804827459595584/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:655/0 lens 224/224 e 0 to 0 dl 1721219455 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1721219365.860096:0:28689:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:2852:x1804827459595328:12345-0@lo:400:kworker/u8:1.0 Request processed in 39us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219365.860102:0:28689:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 663 00000100:00100000:2.0:1721219365.860105:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc84c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+5:2852:x1804827459595584:12345-0@lo:400:kworker/u8:1.0 Request processed in 39us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219365.860111:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 664 00000100:00100000:1.0:1721219365.860122:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:2852:1804827459595328:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219365.860132:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88009c7a97c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:2852:1804827459595584:0@lo:400:kworker/u8:1.0 00010000:00010000:0.0:1721219366.177643:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219367.179724:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219368.181754:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1721219368.623130:0:15116:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1721219368.623141:0:15116:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1721219368.623145:0:15116:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1721219368.623654:0:15116:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:3.0:1721219368.623662:0:15116:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:3.0:1721219368.623702:0:15116:0:(mgs_llog.c:813:mgs_check_marker()) mgs check lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.test_22d 00000040:00080000:3.0:1721219368.624656:0:15117:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 114 count 112 00000040:00080000:1.0:1721219368.625028:0:15116:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].114, 224 off29464 20000000:01000000:1.0:1721219368.625047:0:15116:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre test_22d (null) (null) 00000040:00080000:1.0:1721219368.625094:0:15116:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].115, 120 off29584 00000040:00080000:1.0:1721219368.625186:0:15116:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].116, 224 off29808 00000040:00080000:1.0:1721219368.626076:0:15116:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].118, 224 off29760 20000000:01000000:1.0:1721219368.626087:0:15116:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce020 lustre test_22d (null) (null) 00000040:00080000:1.0:1721219368.626133:0:15116:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].119, 112 off29872 00000040:00080000:1.0:1721219368.626180:0:15116:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].120, 224 off30096 10000000:01000000:1.0:1721219368.626193:0:15116:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1721219368.626209:0:15116:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626229:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626246:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626253:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626258:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626264:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626269:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a02 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626274:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a10 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626280:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a1e expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626285:0:15116:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a2c expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626319:0:15116:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626358:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a2c expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626370:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a2c expref: 17 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.626391:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137125a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595648:0@lo:104: 00000100:00100000:1.0:1721219368.626452:0:15116:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219368.626517:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a1e expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626526:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a1e expref: 17 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.626534:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137122ac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595712:0@lo:104: 00010000:00010000:1.0:1721219368.626553:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a10 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626560:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a10 expref: 17 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.626566:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595776:0@lo:104: 00010000:00010000:1.0:1721219368.626580:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a02 expref: 17 pid: 27118 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219368.626581:0:8340:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1721219368.626586:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a02 expref: 17 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.626592:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595840:0@lo:104: 00000100:00100000:3.0:1721219368.626610:0:8340:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219368.626651:0:15116:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219368.626684:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626691:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 17 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:3.0:1721219368.626696:0:8340:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219368.626715:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137124280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595904:0@lo:104: 00000100:00100000:3.0:1721219368.626723:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595648 00000100:00100000:1.0:1721219368.626736:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595712 00000100:00100000:0.0:1721219368.626741:0:6716:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595840 00000100:00100000:3.0:1721219368.626753:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595776 00000100:00100000:1.0:1721219368.626759:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1721219368.626764:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a1c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15116:x1804827459595648:12345-0@lo:104: 00000100:00100000:2.0:1721219368.626780:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1721219368.626787:0:8340:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1721219368.626788:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15116:x1804827459595712:12345-0@lo:104: 00000100:00100000:3.0:1721219368.626792:0:8340:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137124c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15116:x1804827459595840:12345-0@lo:104: 00010000:00010000:1.0:1721219368.626811:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1721219368.626816:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a1c8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15116:x1804827459595648:12345-0@lo:104: Request processed in 52us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219368.626824:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00010000:00010000:3.0:1721219368.626842:0:8340:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219368.626847:0:8340:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137124c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+5:15116:x1804827459595840:12345-0@lo:104: Request processed in 56us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219368.626854:0:8340:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1721219368.626864:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00010000:00010000:2.0:1721219368.626865:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1721219368.626867:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009c7aa140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15116:x1804827459595776:12345-0@lo:104: 00000100:00100000:2.0:1721219368.626871:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7a97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15116:x1804827459595712:12345-0@lo:104: Request processed in 84us (262us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219368.626875:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1721219368.626878:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00010000:00010000:3.0:1721219368.626879:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.626889:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6ac0 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:1.0:1721219368.626891:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1721219368.626894:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009c7aa140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15116:x1804827459595776:12345-0@lo:104: Request processed in 27us (199us total) trans 0 rc 0/0 00010000:00010000:0.0:1721219368.626896:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1721219368.626900:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 10000000:00010000:3.0:1721219368.626901:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626902:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.626910:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626912:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0fcc0 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219368.626914:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219368.626916:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219368.626920:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219368.626924:0:9965:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1721219368.626925:0:15116:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1721219368.626929:0:9965:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626930:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219368.626936:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.626938:0:9965:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e4fc0 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:2.0:1721219368.626940:0:9965:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219368.626941:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595904 10000000:01000000:0.0:1721219368.626941:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219368.626947:0:9965:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.626949:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219368.626952:0:9965:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.626955:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1721219368.626956:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 10000000:01000000:2.0:1721219368.626957:0:9965:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1721219368.626959:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15116:x1804827459595904:12345-0@lo:104: 00010000:00010000:0.0:1721219368.626963:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626969:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219368.626970:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.626976:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e6ac0/0xd4836d281e001a2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a33 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626977:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.626978:0:9965:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626982:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0fcc0/0xd4836d281e001a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a09 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.626983:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1721219368.626984:0:9965:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1721219368.626986:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15116:x1804827459595904:12345-0@lo:104: Request processed in 27us (61us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219368.626990:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1721219368.626991:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00010000:00010000:3.0:1721219368.626992:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.626993:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1721219368.626995:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.626997:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5200 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219368.626999:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.626999:0:9965:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.627000:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0c000 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:0.0:1721219368.627001:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.627004:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627004:0:9965:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e4fc0/0xd4836d281e001a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a25 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.627006:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219368.627008:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219368.627010:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459596032:0@lo:103:ldlm_bl_02.0 10000000:00010000:0.0:1721219368.627011:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627014:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219368.627015:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1721219368.627016:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219368.627017:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219368.627022:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1721219368.627024:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1721219368.627029:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219368.627032:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.627037:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219368.627039:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219368.627041:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008ed5a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459595968:0@lo:103:ldlm_bl_01.0 00010000:00010000:0.0:1721219368.627042:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.627044:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1721219368.627047:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0c000/0xd4836d281e0019f4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019fb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.627049:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.627054:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff88008c8e5200/0xd4836d281e001a10 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a17 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219368.627056:0:2850:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1721219368.627057:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219368.627058:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219368.627060:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219368.627062:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343da140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459596224:0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219368.627063:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219368.627065:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219368.627067:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219368.627067:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219368.627072:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219368.627087:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459596160:0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219368.627093:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459596096:0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1721219368.627111:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219368.627127:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596032 00010000:00010000:2.0:1721219368.627154:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a02 expref: 18 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:2.0:1721219368.627174:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459595968 00010000:00010000:2.0:1721219368.627181:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a2c expref: 19 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627186:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596224 00000100:00100000:3.0:1721219368.627191:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219368.627191:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219368.627198:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a10 expref: 20 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:2.0:1721219368.627207:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596096 00010000:00010000:2.0:1721219368.627215:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a1e expref: 21 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627216:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596160 00000100:00100000:3.0:1721219368.627224:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179027 00010000:00010000:1.0:1721219368.627224:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 22 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:3.0:1721219368.627230:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2850:x1804827459596032:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:0.0:1721219368.627235:0:15873:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179028 00010000:00010000:3.0:1721219368.627240:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721219368.627240:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179029 00000100:00100000:0.0:1721219368.627241:0:15873:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf10e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2849:x1804827459595968:12345-0@lo:103:ldlm_bl_01.0 00000100:00100000:1.0:1721219368.627245:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179030 00010000:00010000:3.0:1721219368.627246:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a02 expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:2.0:1721219368.627247:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2850:x1804827459596224:12345-0@lo:103:ldlm_bl_01.0 00000100:00100000:1.0:1721219368.627249:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343de3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2851:x1804827459596096:12345-0@lo:103:ldlm_bl_05.0 00010000:00010000:0.0:1721219368.627252:0:15873:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721219368.627255:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721219368.627256:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a02 expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:1.0:1721219368.627257:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219368.627257:0:15873:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a2c expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:2.0:1721219368.627258:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a10 expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:1.0:1721219368.627260:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a1e expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:2.0:1721219368.627270:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a10 expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:0.0:1721219368.627285:0:15873:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a2c expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:1.0:1721219368.627320:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a1e expref: 22 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.627329:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219368.627353:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721219368.627354:0:15873:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219368.627355:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1721219368.627363:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+22:2850:x1804827459596032:12345-0@lo:103:ldlm_bl_02.0 Request processed in 132us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219368.627370:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179027 00000100:00100000:2.0:1721219368.627390:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239aac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2850:x1804827459596224:12345-0@lo:103:ldlm_bl_01.0 Request processed in 145us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219368.627393:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343de3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2851:x1804827459596096:12345-0@lo:103:ldlm_bl_05.0 Request processed in 143us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219368.627397:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179031 00000100:00100000:0.0:1721219368.627402:0:15873:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf10e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_006:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2849:x1804827459595968:12345-0@lo:103:ldlm_bl_01.0 Request processed in 160us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219368.627403:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179029 00000100:00100000:3.0:1721219368.627404:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2852:x1804827459596160:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219368.627407:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179030 00010000:00010000:3.0:1721219368.627411:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721219368.627412:0:15873:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179028 00010000:00010000:3.0:1721219368.627416:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 19 pid: 27116 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.627425:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 19 pid: 27116 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.627434:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219368.627441:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343da140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459596224:0@lo:103:ldlm_bl_01.0 00000100:00100000:1.0:1721219368.627449:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc8980 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459596032:0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219368.627459:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2852:x1804827459596160:12345-0@lo:103:ldlm_bl_02.0 Request processed in 57us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219368.627461:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008ed5a140 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459595968:0@lo:103:ldlm_bl_01.0 00000100:00100000:3.0:1721219368.627465:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179031 00010000:00010000:1.0:1721219368.627503:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 18 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.627529:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 17 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627538:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013239c280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596288:0@lo:104: 00000100:00100000:3.0:1721219368.627550:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459596096:0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1721219368.627556:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc8e40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459596160:0@lo:103:ldlm_bl_02.0 00000100:00100000:1.0:1721219368.627566:0:15116:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219368.627585:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219368.627588:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596288 00010000:00010000:1.0:1721219368.627592:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 17 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627598:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88013239aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596352:0@lo:104: 00000100:00100000:2.0:1721219368.627610:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1721219368.627612:0:15116:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219368.627614:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88013239e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15116:x1804827459596288:12345-0@lo:104: 00010000:00010000:1.0:1721219368.627630:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219368.627632:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596352 00010000:00010000:1.0:1721219368.627637:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 8 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627644:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596416:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219368.627650:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1721219368.627654:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88013239e3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15116:x1804827459596288:12345-0@lo:104: Request processed in 40us (88us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219368.627660:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1721219368.627671:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1721219368.627675:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f64740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15116:x1804827459596352:12345-0@lo:104: 00010000:00010000:2.0:1721219368.627686:0:9965:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1721219368.627689:0:9965:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627695:0:9965:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0f840 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:2.0:1721219368.627697:0:9965:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627703:0:9965:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219368.627708:0:9965:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219368.627713:0:9965:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219368.627713:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1721219368.627718:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f64740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15116:x1804827459596352:12345-0@lo:104: Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219368.627723:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00010000:00010000:3.0:1721219368.627727:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219368.627732:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627732:0:9965:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627737:0:9965:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219368.627739:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a5453840 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219368.627741:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219368.627748:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627748:0:9965:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219368.627752:0:2849:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:00010000:3.0:1721219368.627753:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.627754:0:9965:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e0019e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019ed expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219368.627758:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1721219368.627759:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459596480:0@lo:103:ldlm_bl_05.0 00010000:00010000:2.0:1721219368.627763:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219368.627764:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219368.627765:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219368.627768:0:15116:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 8 pid: 27118 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219368.627776:0:15116:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 8 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:0.0:1721219368.627779:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219368.627780:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219368.627784:0:15116:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596544:192.168.201.58@tcp:104: 00010000:00010000:3.0:1721219368.627793:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219368.627804:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219368.627804:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596480 00000100:00100000:0.0:1721219368.627806:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721219368.627810:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff8800a5453840/0xd4836d281e0019d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e0019df expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219368.627810:0:15116:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1db8f00 going to sleep for 6 seconds 00000100:00100000:0.0:1721219368.627811:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343d9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459596608:0@lo:103:ldlm_bl_04.0 00010000:00010000:2.0:1721219368.627815:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 18 pid: 27116 timeout: 1914 lvb_type: 0 00010000:00010000:1.0:1721219368.627822:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0d200/0xd4836d281e001a33 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a2c expref: 18 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.627826:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219368.627826:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219368.627827:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219368.627829:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219368.627833:0:6718:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596608 00000100:00100000:1.0:1721219368.627840:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137125a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595648:0@lo:104: 00010000:00010000:2.0:1721219368.627848:0:6718:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 18 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:3.0:1721219368.627851:0:6717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179032 00010000:00010000:1.0:1721219368.627851:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff880091e0cd80/0xd4836d281e001a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a1e expref: 18 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:3.0:1721219368.627856:0:6717:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc8e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2849:x1804827459596480:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:1.0:1721219368.627858:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137122ac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595712:0@lo:104: 00010000:00010000:3.0:1721219368.627864:0:6717:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1721219368.627865:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179033 00010000:00010000:1.0:1721219368.627865:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5453cc0/0xd4836d281e001a17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a10 expref: 17 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.627868:0:6717:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 17 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:2.0:1721219368.627868:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc9300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:2852:x1804827459596608:12345-0@lo:103:ldlm_bl_04.0 00000100:00100000:1.0:1721219368.627874:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595776:0@lo:104: 00010000:00010000:2.0:1721219368.627875:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721219368.627876:0:6717:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 16 pid: 27116 timeout: 1914 lvb_type: 0 00010000:00010000:2.0:1721219368.627878:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 16 pid: 27116 timeout: 1914 lvb_type: 0 00010000:00010000:1.0:1721219368.627880:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a54521c0/0xd4836d281e001a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a02 expref: 16 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:2.0:1721219368.627888:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 15 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627888:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595840:0@lo:104: 00010000:00010000:1.0:1721219368.627894:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e61c0/0xd4836d281e0019fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0019f4 expref: 15 pid: 27116 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.627901:0:6717:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219368.627901:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137124280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459595904:0@lo:104: 00010000:00010000:2.0:1721219368.627907:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219368.627907:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd20000/0xd4836d281e0019ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0019e6 expref: 14 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627913:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013239c280 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596288:0@lo:104: 00010000:00010000:1.0:1721219368.627919:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd221c0/0xd4836d281e0019df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e0019d8 expref: 13 pid: 27116 timeout: 1914 lvb_type: 0 00000100:00100000:1.0:1721219368.627926:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88013239aac0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596352:0@lo:104: 00000100:00100000:3.0:1721219368.627931:0:6717:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc8e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:2849:x1804827459596480:12345-0@lo:103:ldlm_bl_05.0 Request processed in 75us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219368.627935:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc9300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:2852:x1804827459596608:12345-0@lo:103:ldlm_bl_04.0 Request processed in 66us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219368.627938:0:6717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179032 00000100:00100000:2.0:1721219368.627941:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179033 00000100:00100000:0.0:1721219368.627945:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343d9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459596608:0@lo:103:ldlm_bl_04.0 00000100:00100000:0.0:1721219368.627964:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf13440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459596480:0@lo:103:ldlm_bl_05.0 00000100:00100000:0.0:1721219368.628766:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219368.628806:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219368.628846:0:6719:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267648 00000100:00100000:1.0:1721219368.628856:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f65a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596416:192.168.201.58@tcp:104: 00000100:00100000:1.0:1721219368.628867:0:15116:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15116:1804827459596544:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219368.628874:0:6719:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 9 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:2.0:1721219368.628907:0:6719:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267712 00010000:00010000:1.0:1721219368.628916:0:15116:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.628918:0:6719:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 10 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:3.0:1721219368.628924:0:6717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179034 00000100:00100000:3.0:1721219368.628933:0:6717:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1836:x1804827511267648:12345-192.168.201.58@tcp:103:ldlm_bl_07.0 00010000:00010000:3.0:1721219368.628946:0:6717:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1721219368.628953:0:6717:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 10 pid: 27118 timeout: 1914 lvb_type: 0 00000100:00100000:2.0:1721219368.628958:0:6719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179035 00000100:00100000:2.0:1721219368.628964:0:6719:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc9c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511267712:12345-192.168.201.58@tcp:103:ldlm_bl_06.0 00010000:00010000:2.0:1721219368.628974:0:6719:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721219368.628978:0:6719:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 10 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.628980:0:6717:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 10 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.628993:0:6717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5451680/0xd4836d281e0019d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b16 expref: 10 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:2.0:1721219368.629003:0:6719:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 9 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:3.0:1721219368.629017:0:6717:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219368.629025:0:6719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a54518c0/0xd4836d281e0019ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b0f expref: 9 pid: 27118 timeout: 1914 lvb_type: 0 00010000:00010000:2.0:1721219368.629038:0:6719:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629044:0:6719:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629055:0:6719:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629060:0:6719:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219368.629065:0:6717:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:1836:x1804827511267648:12345-192.168.201.58@tcp:103:ldlm_bl_07.0 Request processed in 132us (301us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219368.629066:0:6719:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629071:0:6719:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219368.629074:0:6717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179034 00010000:00010000:2.0:1721219368.629076:0:6719:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008cd233c0 already unused, calling callback (ffffffffa0815190) 00010000:00010000:2.0:1721219368.629078:0:6719:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629084:0:6719:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629103:0:6719:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219368.629119:0:6719:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721219368.629129:0:15116:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.629139:0:15116:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219368.629144:0:15116:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008cd233c0/0xd4836d281e001a6b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15116 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219368.629149:0:6719:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc9c80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:1835:x1804827511267712:12345-192.168.201.58@tcp:103:ldlm_bl_06.0 Request processed in 184us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219368.629158:0:6719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179035 00010000:00010000:0.0:1721219369.183655:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219370.185716:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219370.350046:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219370.350119:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219370.350164:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.350197:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267840 00000100:00100000:0.0:1721219370.350205:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.350253:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 665 00000100:00100000:3.0:1721219370.350255:0:27118:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267776 00000100:00100000:2.0:1721219370.350289:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:1836:x1804827511267840:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00010000:00000080:2.0:1721219370.350332:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bca140 x1804827511267840/t0(0) o400->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:660/0 lens 224/224 e 0 to 0 dl 1721219460 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:2.0' 00000100:00100000:3.0:1721219370.350334:0:27118:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1057 00000100:00100000:3.0:1721219370.350340:0:27118:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:1837:x1804827511267776:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219370.350349:0:14647:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267968 00000100:00100000:1.0:1721219370.350368:0:15816:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511267904 00000100:00100000:2.0:1721219370.350390:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bca140 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:1836:x1804827511267840:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 130us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219370.350390:0:14647:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 916 00000100:00100000:3.0:1721219370.350393:0:27118:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:1837:x1804827511267776:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 52us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.350399:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 665 00000100:00100000:0.0:1721219370.350399:0:14647:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1836:x1804827511267968:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:3.0:1721219370.350400:0:27118:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1057 00000100:00100000:1.0:1721219370.350421:0:15816:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 917 00000100:00100000:1.0:1721219370.350426:0:15816:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bcaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1837:x1804827511267904:12345-192.168.201.58@tcp:400:kworker/u8:2.0 00000100:00100000:0.0:1721219370.350448:0:14647:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bca600 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_007:2df8dc7e-94ba-4991-a575-93aaf526cb45+29:1836:x1804827511267968:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 49us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219370.350459:0:14647:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 916 00000100:00100000:1.0:1721219370.350509:0:15816:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bcaac0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_017:2df8dc7e-94ba-4991-a575-93aaf526cb45+33:1837:x1804827511267904:12345-192.168.201.58@tcp:400:kworker/u8:2.0 Request processed in 42us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219370.350517:0:15816:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 917 00000100:00100000:0.0:1721219370.393670:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.393797:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268032 00000100:00100000:2.0:1721219370.393844:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1058 00000100:00100000:2.0:1721219370.393850:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:4616:x1804827511268032:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.393863:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.393881:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b2b expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.393907:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.393918:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.393944:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5d40, rc 0) 00000100:00100000:2.0:1721219370.393992:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268032:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 141us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.394000:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1058 00000100:00100000:0.0:1721219370.394905:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.395033:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268096 00000100:00100000:2.0:1721219370.395078:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1059 00000100:00100000:2.0:1721219370.395084:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268096:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.395230:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268096:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 145us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.395239:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1059 00000100:00100000:0.0:1721219370.396148:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.396300:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268160 00000100:00100000:2.0:1721219370.396345:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1060 00000100:00100000:2.0:1721219370.396351:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268160:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.396619:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268160:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 266us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.396628:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1060 00000100:00100000:0.0:1721219370.397694:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.397812:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268224 00000100:00100000:2.0:1721219370.397859:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1061 00000100:00100000:2.0:1721219370.397865:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23346:x1804827511268224:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1721219370.398236:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23346:x1804827511268224:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 370us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.398246:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1061 00000100:00100000:0.0:1721219370.399303:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.399428:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268288 00000100:00100000:2.0:1721219370.399509:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1062 00000100:00100000:2.0:1721219370.399515:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23346:x1804827511268288:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1721219370.399751:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23346:x1804827511268288:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.399760:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1062 00000100:00100000:0.0:1721219370.400826:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.400948:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268352 00000100:00100000:2.0:1721219370.400993:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1063 00000100:00100000:2.0:1721219370.400999:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268352:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.401009:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.401019:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b32 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.401039:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 9 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.401047:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 9 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.401054:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e46c0, rc 0) 00000100:00100000:2.0:1721219370.401099:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511268352:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 99us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.401107:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1063 00000100:00100000:0.0:1721219370.402016:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219370.402142:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268416 00000100:00100000:2.0:1721219370.402187:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1064 00000100:00100000:2.0:1721219370.402193:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511268416:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.402313:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511268416:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 118us (301us total) trans 0 rc -2/-2 00000100:00100000:2.0:1721219370.402336:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1064 10000000:01000000:0.0:1721219370.556590:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219370.556597:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a6512800 from 118 10000000:01000000:0.0:1721219370.556603:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219370.556645:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.556661:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.556696:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.556725:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.556799:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.556847:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4c00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.556908:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596672 00000100:00100000:2.0:1721219370.556977:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1065 00000100:00100000:2.0:1721219370.556986:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:6729:x1804827459596672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.557002:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.557019:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a80 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.557046:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a80 expref: 12 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.557055:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a80 expref: 12 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.557063:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e4000, rc 0) 00000100:00100000:2.0:1721219370.557119:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459596672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.557126:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1065 00000100:00100000:0.0:1721219370.557181:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.557199:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.557208:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.557289:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.557318:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.557343:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4c00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.557374:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596736 00000100:00100000:2.0:1721219370.557404:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1066 00000100:00100000:2.0:1721219370.557408:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459596736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.557563:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459596736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.557570:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1066 00000100:00100000:0.0:1721219370.557599:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.557628:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.557667:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.557690:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4c00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.557719:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596800 00000100:00100000:2.0:1721219370.557747:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1067 00000100:00100000:2.0:1721219370.557751:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459596800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.557972:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459596800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.557979:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1067 00000100:00100000:0.0:1721219370.557999:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219370.558372:0:15143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15143:1804827459596864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.558422:0:15143:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.558449:0:15143:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5613b40 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.558544:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596864 00000100:00100000:2.0:1721219370.558588:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1068 00000100:00100000:2.0:1721219370.558593:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15143:x1804827459596864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.559003:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c63850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15143:x1804827459596864:12345-0@lo:502:llog_process_th.0 Request processed in 407us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.559015:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1068 00000100:00100000:1.0:1721219370.559105:0:15143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15143:1804827459596864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.559162:0:15143:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15143:1804827459596928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.559204:0:15143:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.559235:0:15143:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5613b40 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.559284:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596928 00000100:00100000:2.0:1721219370.559318:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1069 00000100:00100000:2.0:1721219370.559322:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15143:x1804827459596928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.559588:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15143:x1804827459596928:12345-0@lo:502:llog_process_th.0 Request processed in 264us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.559595:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1069 00000100:00100000:1.0:1721219370.559638:0:15143:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15143:1804827459596928:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219370.559677:0:15143:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 121 count 120 00000020:01000000:0.0:1721219370.559769:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 118-120 (rc=0) 10000000:01000000:0.0:1721219370.559794:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219370.559799:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.559823:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.559831:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1721219370.559834:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 114 10000000:01000000:0.0:1721219370.559836:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1721219370.559852:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.559858:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.559866:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.559879:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.559914:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.559930:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4c00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.559937:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459596992 00000100:00100000:2.0:1721219370.559967:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1070 00000100:00100000:2.0:1721219370.559971:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459596992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.559979:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.559988:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a8e expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.560004:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a8e expref: 13 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.560011:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a8e expref: 13 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.560025:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e6640, rc 0) 00000100:00100000:2.0:1721219370.560068:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459596992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 96us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.560075:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1070 00000100:00100000:0.0:1721219370.560105:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459596992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.560117:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.560125:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.560162:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.560186:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.560198:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4c00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.560214:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597056 00000100:00100000:2.0:1721219370.560252:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1071 00000100:00100000:2.0:1721219370.560281:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459597056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.560401:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459597056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.560412:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1071 00000100:00100000:0.0:1721219370.560429:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.560463:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.560529:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.560541:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4c00 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.560555:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597120 00000100:00100000:2.0:1721219370.560593:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1072 00000100:00100000:2.0:1721219370.560598:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459597120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.560836:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459597120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.560844:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1072 00000100:00100000:0.0:1721219370.560867:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219370.561131:0:15144:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15144:1804827459597184:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.561183:0:15144:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.561213:0:15144:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a5613b40 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.561241:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597184 00000100:00100000:2.0:1721219370.561289:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1073 00000100:00100000:2.0:1721219370.561293:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15144:x1804827459597184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.561676:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099430050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15144:x1804827459597184:12345-0@lo:502:llog_process_th.0 Request processed in 380us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.561684:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1073 00000100:00100000:1.0:1721219370.561783:0:15144:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15144:1804827459597184:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1721219370.561818:0:15144:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219370.561827:0:15144:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219370.561835:0:15144:0:(obd_config.c:1460:class_process_config()) marker 75 (0x1) lustre-MDT0000-m new lustre.test_22d 00000020:00000080:1.0:1721219370.561841:0:15144:0:(obd_config.c:1384:class_process_config()) processing cmd: ce020 00020000:01000000:1.0:1721219370.561875:0:15144:0:(lod_pool.c:497:lod_pool_new()) test_22d is pool #2 00080000:10000000:1.0:1721219370.563077:0:15144:0:(osd_index.c:2094:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x55:0x0] (8/8/4) registered 00080000:10000000:0.0:1721219370.575322:0:15144:0:(osd_index.c:2094:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x56:0x0] (8/8/4) registered 00080000:10000000:0.0:1721219370.586810:0:15144:0:(osd_index.c:2094:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x57:0x0] (8/8/4) registered 00000100:00100000:1.0:1721219370.597427:0:15144:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15144:1804827459597248:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.597510:0:15144:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.597535:0:15144:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.597568:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597248 00000100:00100000:2.0:1721219370.597605:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1074 00000100:00100000:2.0:1721219370.597610:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15144:x1804827459597248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.597870:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099435850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15144:x1804827459597248:12345-0@lo:502:llog_process_th.0 Request processed in 257us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.597878:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1074 00000100:00100000:1.0:1721219370.597901:0:15144:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15144:1804827459597248:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1721219370.597929:0:15144:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1721219370.597934:0:15144:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219370.597935:0:15144:0:(obd_config.c:1460:class_process_config()) marker 75 (0x2) lustre-MDT0000-m new lustre.test_22d 00000040:00080000:1.0:1721219370.597939:0:15144:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 117 count 115 00000020:01000000:0.0:1721219370.598064:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 114-116 (rc=0) 10000000:01000000:0.0:1721219370.598089:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1721219370.598094:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.598104:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.598114:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219370.598116:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880136319800 from 118 10000000:01000000:0.0:1721219370.598118:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219370.598136:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.598142:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.598149:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.598163:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.598198:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.598229:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.598248:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597312 00000100:00100000:2.0:1721219370.598297:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1075 00000100:00100000:2.0:1721219370.598301:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459597312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.598309:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.598318:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001a9c expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.598334:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001a9c expref: 14 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.598341:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a9c expref: 14 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.598348:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5680, rc 0) 00000100:00100000:2.0:1721219370.598388:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459597312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.598395:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1075 00000100:00100000:0.0:1721219370.598426:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.598440:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.598447:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.598515:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.598542:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.598555:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.598595:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597376 00000100:00100000:2.0:1721219370.598617:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1076 00000100:00100000:2.0:1721219370.598620:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459597376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.598717:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099430850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459597376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.598724:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1076 00000100:00100000:0.0:1721219370.598755:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.598789:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.598840:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.598857:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.598862:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597440 00000100:00100000:2.0:1721219370.598888:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1077 00000100:00100000:2.0:1721219370.598892:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459597440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.599059:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459597440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.599067:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1077 00000100:00100000:0.0:1721219370.599114:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219370.599425:0:15220:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15220:1804827459597504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.599512:0:15220:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.599544:0:15220:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.599569:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597504 00000100:00100000:2.0:1721219370.599600:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1078 00000100:00100000:2.0:1721219370.599603:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15220:x1804827459597504:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.599982:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15220:x1804827459597504:12345-0@lo:502:llog_process_th.0 Request processed in 376us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.599994:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1078 00000100:00100000:1.0:1721219370.600043:0:15220:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15220:1804827459597504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.600103:0:15220:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15220:1804827459597568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.600154:0:15220:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.600172:0:15220:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.600184:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597568 00000100:00100000:2.0:1721219370.600212:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1079 00000100:00100000:2.0:1721219370.600216:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15220:x1804827459597568:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.600534:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15220:x1804827459597568:12345-0@lo:502:llog_process_th.0 Request processed in 315us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.600546:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1079 00000100:00100000:1.0:1721219370.600577:0:15220:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15220:1804827459597568:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219370.600605:0:15220:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 121 count 120 00000020:01000000:0.0:1721219370.600646:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 118-120 (rc=0) 10000000:01000000:0.0:1721219370.600668:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219370.600672:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.600679:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.600686:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1721219370.600688:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1721219370.600690:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1721219370.600707:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.600732:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.600742:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.600761:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.600802:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.600836:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.600855:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597632 00000100:00100000:2.0:1721219370.600877:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1080 00000100:00100000:2.0:1721219370.600880:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459597632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.600887:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.600896:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001aaa expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.600910:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001aaa expref: 15 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.600929:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001aaa expref: 15 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.600935:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e7cc0, rc 0) 00000100:00100000:2.0:1721219370.600965:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459597632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.600971:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1080 00000100:00100000:0.0:1721219370.600986:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.600997:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.601004:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.601040:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.601063:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.601074:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.601077:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597696 00000100:00100000:2.0:1721219370.601092:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1081 00000100:00100000:2.0:1721219370.601095:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459597696:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.601167:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459597696:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (104us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.601174:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1081 00000100:00100000:0.0:1721219370.601197:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597696:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.601230:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.601300:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.601317:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.601327:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597760 00000100:00100000:2.0:1721219370.601352:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1082 00000100:00100000:2.0:1721219370.601359:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459597760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.601627:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459597760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 267us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.601635:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1082 00000100:00100000:0.0:1721219370.601648:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597760:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1721219370.602442:0:15221:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:0.0:1721219370.602533:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:0.0:1721219370.602566:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1721219370.602572:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.602583:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.602593:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219370.602596:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009928e000 from 118 10000000:01000000:0.0:1721219370.602599:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219370.602616:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.602625:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.602634:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.602652:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.602689:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.602721:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.602764:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597824 00000100:00100000:2.0:1721219370.602794:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1083 00000100:00100000:2.0:1721219370.602800:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459597824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.602810:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.602821:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001ab8 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.602857:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 16 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.602868:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 16 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.602878:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e7180, rc 0) 00000100:00100000:2.0:1721219370.602918:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459597824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.602928:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1083 00000100:00100000:0.0:1721219370.602944:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.602960:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.602970:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.603019:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.603070:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.603102:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.603123:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597888 00000100:00100000:2.0:1721219370.603142:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1084 00000100:00100000:2.0:1721219370.603145:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459597888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.603221:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459597888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.603227:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1084 00000100:00100000:0.0:1721219370.603243:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.603296:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.603344:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.603361:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.603366:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459597952 00000100:00100000:2.0:1721219370.603381:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1085 00000100:00100000:2.0:1721219370.603385:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459597952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.603581:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459597952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.603588:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1085 00000100:00100000:0.0:1721219370.603635:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459597952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219370.603938:0:15222:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15222:1804827459598016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.603989:0:15222:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.604016:0:15222:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.604042:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598016 00000100:00100000:2.0:1721219370.604073:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1086 00000100:00100000:2.0:1721219370.604076:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15222:x1804827459598016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.604398:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15222:x1804827459598016:12345-0@lo:502:llog_process_th.0 Request processed in 319us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.604411:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1086 00000100:00100000:1.0:1721219370.604524:0:15222:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15222:1804827459598016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.604585:0:15222:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15222:1804827459598080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219370.604628:0:15222:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.604643:0:15222:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.604649:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598080 00000100:00100000:2.0:1721219370.604678:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1087 00000100:00100000:2.0:1721219370.604682:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88009b8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15222:x1804827459598080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219370.604903:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88009b8d1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15222:x1804827459598080:12345-0@lo:502:llog_process_th.0 Request processed in 219us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.604910:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1087 00000100:00100000:1.0:1721219370.604937:0:15222:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f67200 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15222:1804827459598080:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219370.604965:0:15222:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 121 count 120 00000020:01000000:0.0:1721219370.605031:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 118-120 (rc=0) 10000000:01000000:0.0:1721219370.605050:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219370.605054:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.605062:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.605069:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1721219370.605071:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:0.0:1721219370.605074:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1721219370.605087:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.605093:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.605100:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.605112:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.605151:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.605187:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.605209:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598144 00000100:00100000:2.0:1721219370.605228:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1088 00000100:00100000:2.0:1721219370.605231:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459598144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.605238:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.605246:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001ac6 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.605277:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.605285:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.605291:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5440, rc 0) 00000100:00100000:2.0:1721219370.605318:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e97050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459598144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.605324:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1088 00000100:00100000:0.0:1721219370.605338:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.605350:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.605357:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.605392:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.605416:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.605426:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.605433:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598208 00000100:00100000:2.0:1721219370.605447:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1089 00000100:00100000:2.0:1721219370.605450:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459598208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.605561:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e90850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459598208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.605568:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1089 00000100:00100000:0.0:1721219370.605571:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.605591:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.605626:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.605637:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.605644:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598272 00000100:00100000:2.0:1721219370.605659:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1090 00000100:00100000:2.0:1721219370.605662:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459598272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.605833:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e95050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459598272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.605840:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1090 00000100:00100000:0.0:1721219370.605842:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1721219370.606842:0:15223:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:0.0:1721219370.606940:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:0.0:1721219370.606967:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1721219370.606972:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.606984:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219370.606995:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1721219370.606998:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6c10000 from 1 10000000:01000000:0.0:1721219370.607009:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1721219370.607028:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.607038:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.607048:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.607065:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.607102:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.607137:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.607222:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598336 00000100:00100000:2.0:1721219370.607280:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1091 00000100:00100000:2.0:1721219370.607285:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459598336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219370.607295:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219370.607305:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001ad4 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.607323:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 18 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.607331:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 18 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219370.607338:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5b00, rc 0) 00000100:00100000:2.0:1721219370.607375:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e94850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459598336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.607382:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1091 00000100:00100000:0.0:1721219370.607392:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219370.607407:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.607417:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219370.607466:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219370.607548:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.607563:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219370.607567:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598400 00000100:00100000:2.0:1721219370.607608:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1092 00000100:00100000:2.0:1721219370.607612:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459598400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219370.607683:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e92050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459598400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 70us (136us total) trans 0 rc -2/-2 00000100:00100000:2.0:1721219370.607690:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1092 00000100:00100000:0.0:1721219370.607706:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459598400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1721219370.607733:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1721219370.607738:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219370.607747:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219370.867629:0:2851:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1721219370.867650:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459598656:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219370.867666:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459598720:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219370.867716:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.867716:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2849:1804827459598464:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219370.867732:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2850:1804827459598592:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219370.867742:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459598528:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1721219370.867753:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598656 00000100:00100000:3.0:1721219370.867764:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.867766:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.867790:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 918 00000100:00100000:3.0:1721219370.867793:0:8328:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598528 00000100:00100000:2.0:1721219370.867794:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598464 00000100:00100000:0.0:1721219370.867796:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343d8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459598656:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219370.867807:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2849:1804827459598784:0@lo:400:kworker/u8:1.0 00000100:00100000:3.0:1721219370.867817:0:8328:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00000100:00100000:3.0:1721219370.867822:0:8328:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:2851:x1804827459598528:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1721219370.867825:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219370.867828:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 666 00000100:00100000:2.0:1721219370.867833:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2849:x1804827459598464:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219370.867848:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343d8e40 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+6:2851:x1804827459598656:12345-0@lo:400:kworker/u8:1.0 Request processed in 51us (132us total) trans 0 rc 0/0 00010000:00000080:2.0:1721219370.867850:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880098f67200 x1804827459598464/t0(0) o400->lustre-MDT0000-lwp-OST0000_UUID@0@lo:660/0 lens 224/224 e 0 to 0 dl 1721219460 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00002000:00000024:3.0:1721219370.867851:0:8328:0:(ofd_obd.c:740:ofd_statfs()) blocks cached 0 granted 511770624 pending 0 free 3458203648 avail 3456106496 00000100:00100000:0.0:1721219370.867855:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 918 00000100:00100000:1.0:1721219370.867863:0:27341:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598784 00000100:00100000:0.0:1721219370.867882:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219370.867887:0:27341:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 667 00000100:00100000:2.0:1721219370.867889:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f67200 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+5:2849:x1804827459598464:12345-0@lo:400:kworker/u8:1.0 Request processed in 57us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219370.867892:0:27341:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2849:x1804827459598784:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219370.867896:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 666 00000100:00100000:3.0:1721219370.867900:0:8328:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343dbdc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:2851:x1804827459598528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219370.867907:0:8328:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00010000:00000080:1.0:1721219370.867907:0:27341:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff880098f65a40 x1804827459598784/t0(0) o400->lustre-MDT0000-lwp-MDT0000_UUID@0@lo:660/0 lens 224/224 e 0 to 0 dl 1721219460 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:0.0:1721219370.867907:0:15807:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598720 00000100:00100000:2.0:1721219370.867919:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219370.867923:0:15807:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 919 00000100:00100000:0.0:1721219370.867926:0:15807:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bcc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2852:x1804827459598720:12345-0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219370.867940:0:27341:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f65a40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:2849:x1804827459598784:12345-0@lo:400:kworker/u8:1.0 Request processed in 48us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.867942:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598592 00000100:00100000:1.0:1721219370.867947:0:27341:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 667 00000100:00100000:3.0:1721219370.867948:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcb900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459598656:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219370.867952:0:15807:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bcc740 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_008:lustre-MDT0000-mdtlov_UUID+5:2852:x1804827459598720:12345-0@lo:400:kworker/u8:1.0 Request processed in 25us (70us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.867959:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 668 00000100:00100000:0.0:1721219370.867959:0:15807:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 919 00000100:00100000:3.0:1721219370.867960:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:2851:1804827459598528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1721219370.867963:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2850:x1804827459598592:12345-0@lo:400:kworker/u8:1.0 00010000:00000080:2.0:1721219370.867972:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88008bf10e40 x1804827459598592/t0(0) o400->lustre-MDT0000-lwp-OST0001_UUID@0@lo:660/0 lens 224/224 e 0 to 0 dl 1721219460 ref 1 fl Interpret:H/0/0 rc 0/0 job:'kworker/u8:1.0' 00000100:00100000:1.0:1721219370.867982:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcaf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:2849:1804827459598464:0@lo:400:kworker/u8:1.0 00000100:00100000:0.0:1721219370.867984:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:2852:1804827459598720:0@lo:400:kworker/u8:1.0 00000100:00100000:1.0:1721219370.867992:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcc280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:2849:1804827459598784:0@lo:400:kworker/u8:1.0 00000100:00100000:2.0:1721219370.867997:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf10e40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0001_UUID+5:2850:x1804827459598592:12345-0@lo:400:kworker/u8:1.0 Request processed in 34us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219370.868003:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 668 00000100:00100000:2.0:1721219370.868027:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcb440 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:2850:1804827459598592:0@lo:400:kworker/u8:1.0 00010000:00010000:3.0:1721219371.187672:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1721219371.301019:0:15354:0:(class_obd.c:310:class_handle_ioctl()) cmd = c008667f 00000020:00000080:3.0:1721219371.301029:0:15354:0:(class_obd.c:134:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1721219371.301034:0:15354:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1721219371.302108:0:15354:0:(class_obd.c:310:class_handle_ioctl()) cmd = c00866bc 20000000:00000080:3.0:1721219371.302117:0:15354:0:(mgs_handler.c:993:mgs_iocontrol()) handling ioctl cmd 0xc00866bc 20000000:01000000:3.0:1721219371.302156:0:15354:0:(mgs_llog.c:813:mgs_check_marker()) mgs check lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.test_22d.lustre-OST0000_UUID 00000040:00080000:1.0:1721219371.303154:0:15355:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 117 count 115 00000040:00080000:3.0:1721219371.303696:0:15354:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].117, 224 off30032 20000000:01000000:3.0:1721219371.303721:0:15354:0:(mgs_llog.c:1061:record_base()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre test_22d lustre-OST0000_UUID (null) 00000040:00080000:3.0:1721219371.303783:0:15354:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].118, 144 off30176 00000040:00080000:3.0:1721219371.303897:0:15354:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x4:0x0].119, 224 off30400 00000040:00080000:3.0:1721219371.304835:0:15354:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].121, 224 off30320 20000000:01000000:3.0:1721219371.304847:0:15354:0:(mgs_llog.c:1061:record_base()) lcfg lustre-clilov 0xce021 lustre test_22d lustre-OST0000_UUID (null) 00000040:00080000:3.0:1721219371.304894:0:15354:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].122, 136 off30456 00000040:00080000:3.0:1721219371.304942:0:15354:0:(llog_osd.c:739:llog_osd_write_rec()) added record [0xa:0x3:0x0].123, 224 off30680 10000000:01000000:3.0:1721219371.304957:0:15354:0:(mgc_request.c:90:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1721219371.304973:0:15354:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.304992:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305000:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305007:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a80 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305021:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a8e expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305026:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001a9c expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305032:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001aaa expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305037:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305042:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305047:0:15354:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305052:0:15354:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305090:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305103:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 17 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.305116:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459598848:0@lo:104: 00000100:00100000:3.0:1721219371.305176:0:15354:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219371.305218:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305239:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 17 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.305270:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343dd580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459598912:0@lo:104: 00010000:00010000:3.0:1721219371.305297:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305304:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 17 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.305310:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343db900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459598976:0@lo:104: 00010000:00010000:3.0:1721219371.305325:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001aaa expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.305327:0:6715:0:(service.c:173:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1721219371.305331:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001aaa expref: 17 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.305337:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343ddf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599040:0@lo:104: 00010000:00010000:3.0:1721219371.305354:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a9c expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305361:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a9c expref: 17 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:2.0:1721219371.305365:0:6715:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219371.305367:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343d97c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599104:0@lo:104: 00000100:00100000:2.0:1721219371.305419:0:6715:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.305434:0:6715:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219371.305466:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598848 00000100:00100000:2.0:1721219371.305467:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598912 00000100:00100000:3.0:1721219371.305517:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599040 00000100:00100000:0.0:1721219371.305520:0:8340:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459598976 00000100:00100000:2.0:1721219371.305522:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1721219371.305528:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008a1c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15354:x1804827459598848:12345-0@lo:104: 00000100:00100000:3.0:1721219371.305531:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1721219371.305536:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf104c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15354:x1804827459598912:12345-0@lo:104: 00000100:00100000:1.0:1721219371.305547:0:6716:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1721219371.305556:0:6716:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf12140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15354:x1804827459599040:12345-0@lo:104: 00010000:00010000:2.0:1721219371.305581:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1721219371.305587:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008a1c8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15354:x1804827459598848:12345-0@lo:104: Request processed in 59us (412us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219371.305590:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1721219371.305594:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1721219371.305595:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf104c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+6:15354:x1804827459598912:12345-0@lo:104: Request processed in 59us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.305602:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:3.0:1721219371.305618:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:3.0:1721219371.305622:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf13900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15354:x1804827459598976:12345-0@lo:104: 00010000:00010000:1.0:1721219371.305651:0:6716:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1721219371.305660:0:6716:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf12140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15354:x1804827459599040:12345-0@lo:104: Request processed in 104us (223us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219371.305662:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:2.0:1721219371.305665:0:9965:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:3.0:1721219371.305666:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf13900 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15354:x1804827459598976:12345-0@lo:104: Request processed in 44us (247us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219371.305670:0:9965:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219371.305671:0:6716:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1721219371.305675:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00010000:00010000:0.0:1721219371.305676:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1721219371.305680:0:9965:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0f600 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:0.0:1721219371.305682:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219371.305683:0:9965:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.305691:0:9965:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.305693:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0c6c0 already unused, calling callback (ffffffffa0aca5c0) 00010000:00010000:3.0:1721219371.305694:0:9818:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1721219371.305696:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:2.0:1721219371.305697:0:9965:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305698:0:9818:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219371.305702:0:9965:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1721219371.305703:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305705:0:9818:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0cfc0 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219371.305707:0:9818:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305716:0:9818:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219371.305717:0:8341:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:3.0:1721219371.305721:0:9818:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:0.0:1721219371.305723:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219371.305724:0:8341:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219371.305726:0:9818:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1721219371.305727:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219371.305728:0:9965:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.305734:0:9965:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219371.305738:0:8341:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0c240 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:1.0:1721219371.305749:0:8341:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305754:0:9818:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.305758:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219371.305759:0:8341:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305760:0:9818:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1721219371.305760:0:9965:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.305763:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:1.0:1721219371.305769:0:8341:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:1.0:1721219371.305776:0:8341:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1721219371.305778:0:9965:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0f600/0xd4836d281e001ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001adb expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305779:0:9818:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.305779:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.305785:0:9818:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0cfc0/0xd4836d281e001aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001ab1 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.305785:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0c6c0/0xd4836d281e001ac6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001acd expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.305789:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219371.305790:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1721219371.305792:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219371.305799:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219371.305800:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219371.305801:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1721219371.305801:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219371.305803:0:8341:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.305804:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219371.305805:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1721219371.305806:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459599168:0@lo:103:ldlm_bl_05.0 00010000:00010000:1.0:1721219371.305811:0:8341:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1721219371.305816:0:2851:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bcbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459599296:0@lo:103:ldlm_bl_02.0 00010000:00010000:1.0:1721219371.305821:0:8341:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.305823:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8801343d9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459599232:0@lo:103:ldlm_bl_04.0 00010000:00010000:1.0:1721219371.305829:0:8341:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0c240/0xd4836d281e001ab8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001abf expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.305840:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219371.305844:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219371.305846:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219371.305851:0:15354:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219371.305857:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219371.305874:0:2849:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459599360:0@lo:103:ldlm_bl_03.0 00000100:00100000:0.0:1721219371.305876:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219371.305883:0:2851:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.305896:0:6719:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599168 00010000:00010000:2.0:1721219371.305911:0:6719:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 18 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:0.0:1721219371.305913:0:6717:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599232 00010000:00010000:3.0:1721219371.305914:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a8e expref: 18 pid: 27116 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219371.305918:0:2849:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219371.305923:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a8e expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:0.0:1721219371.305926:0:6717:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001aaa expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.305930:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137124c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599424:0@lo:104: 00000100:00100000:2.0:1721219371.305936:0:6719:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599296 00010000:00010000:2.0:1721219371.305944:0:6719:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 20 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:0.0:1721219371.305945:0:6717:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599360 00000100:00100000:3.0:1721219371.305948:0:15354:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1721219371.305952:0:6717:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:2.0:1721219371.305959:0:6719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179036 00000100:00100000:2.0:1721219371.305963:0:6719:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf176c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2850:x1804827459599168:12345-0@lo:103:ldlm_bl_05.0 00000100:00100000:3.0:1721219371.305964:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599104 00000100:00100000:1.0:1721219371.305967:0:6718:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179037 00010000:00010000:2.0:1721219371.305972:0:6719:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1721219371.305973:0:6717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179038 00010000:00010000:2.0:1721219371.305975:0:6719:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:1.0:1721219371.305975:0:6718:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bccc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2852:x1804827459599232:12345-0@lo:103:ldlm_bl_04.0 00000100:00100000:0.0:1721219371.305978:0:6717:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012e28f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2851:x1804827459599296:12345-0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219371.305979:0:20782:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599424 00010000:00010000:2.0:1721219371.305983:0:6719:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.305988:0:6718:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219371.305988:0:6717:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721219371.305990:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1721219371.305994:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8801343da140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15354:x1804827459599104:12345-0@lo:104: 00010000:00010000:1.0:1721219371.305995:0:6718:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001aaa expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:2.0:1721219371.305996:0:6719:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721219371.305998:0:6717:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:0.0:1721219371.306006:0:6717:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:3.0:1721219371.306020:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1721219371.306021:0:6719:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf176c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+21:2850:x1804827459599168:12345-0@lo:103:ldlm_bl_05.0 Request processed in 58us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.306024:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8801343da140 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+4:15354:x1804827459599104:12345-0@lo:104: Request processed in 30us (174us total) trans 0 rc 0/0 00010000:00010000:1.0:1721219371.306026:0:6718:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001aaa expref: 21 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:2.0:1721219371.306028:0:6719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179036 00000100:00100000:3.0:1721219371.306030:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1721219371.306038:0:20782:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1721219371.306041:0:20782:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15354:x1804827459599424:12345-0@lo:104: 00010000:00010000:0.0:1721219371.306046:0:6717:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219371.306048:0:6718:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1721219371.306052:0:6719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179039 00000100:00100000:2.0:1721219371.306055:0:6719:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880098f64740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2849:x1804827459599360:12345-0@lo:103:ldlm_bl_03.0 00010000:00010000:2.0:1721219371.306062:0:6719:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1721219371.306065:0:6719:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 20 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:2.0:1721219371.306072:0:6719:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 20 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:2.0:1721219371.306080:0:6719:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721219371.306082:0:6717:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012e28f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2851:x1804827459599296:12345-0@lo:103:ldlm_bl_02.0 Request processed in 103us (198us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219371.306085:0:20782:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1721219371.306088:0:20782:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122600 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15354:x1804827459599424:12345-0@lo:104: Request processed in 46us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.306089:0:6717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179038 00000100:00100000:3.0:1721219371.306094:0:20782:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:1.0:1721219371.306096:0:6718:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bccc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+20:2852:x1804827459599232:12345-0@lo:103:ldlm_bl_04.0 Request processed in 121us (220us total) trans 0 rc 0/0 00010000:00010000:3.0:1721219371.306106:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1721219371.306109:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.306109:0:6719:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880098f64740 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+19:2849:x1804827459599360:12345-0@lo:103:ldlm_bl_03.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219371.306109:0:6718:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179037 00000100:00100000:2.0:1721219371.306114:0:6719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179039 00010000:00010000:3.0:1721219371.306115:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0f840 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219371.306117:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.306122:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219371.306127:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219371.306132:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219371.306149:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.306152:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459599168:0@lo:103:ldlm_bl_05.0 00010000:00010000:3.0:1721219371.306154:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219371.306161:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219371.306163:0:2849:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2849:1804827459599360:0@lo:103:ldlm_bl_03.0 00010000:00010000:3.0:1721219371.306165:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0f840/0xd4836d281e001a9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001aa3 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.306167:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343d9c80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459599232:0@lo:103:ldlm_bl_04.0 00000100:00100000:2.0:1721219371.306168:0:2850:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137124280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459599488:0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219371.306174:0:6720:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1721219371.306175:0:6720:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.306186:0:6720:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0d200 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:3.0:1721219371.306187:0:6720:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.306187:0:2850:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1721219371.306192:0:6720:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:3.0:1721219371.306197:0:6720:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:3.0:1721219371.306201:0:6720:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1721219371.306206:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599488 00010000:00010000:2.0:1721219371.306207:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219371.306216:0:6720:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.306221:0:6720:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1721219371.306223:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a9c expref: 18 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:3.0:1721219371.306229:0:6720:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.306233:0:2852:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1721219371.306234:0:6720:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0d200/0xd4836d281e001a8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a95 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.306266:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219371.306267:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459599552:0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219371.306268:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1721219371.306269:0:6720:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1721219371.306291:0:2851:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bcbdc0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2851:1804827459599296:0@lo:103:ldlm_bl_02.0 00000100:00100000:0.0:1721219371.306296:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.306306:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599552 00010000:00010000:3.0:1721219371.306316:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd4836d281e001a80 expref: 19 pid: 27116 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.306321:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179040 00010000:00010000:1.0:1721219371.306322:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a8e expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:3.0:1721219371.306325:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd4836d281e001a80 expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:0.0:1721219371.306326:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88008bf150c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+19:2850:x1804827459599488:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:0.0:1721219371.306334:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1721219371.306338:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a9c expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.306346:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137121c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599616:0@lo:104: 00010000:00010000:0.0:1721219371.306347:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a9c expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:1.0:1721219371.306349:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179041 00000100:00100000:1.0:1721219371.306355:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc8e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+19:2852:x1804827459599552:12345-0@lo:103:ldlm_bl_01.0 00010000:00010000:0.0:1721219371.306356:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1721219371.306365:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1721219371.306373:0:15354:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219371.306379:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a8e expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:0.0:1721219371.306380:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88008bf150c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+19:2850:x1804827459599488:12345-0@lo:103:ldlm_bl_01.0 Request processed in 54us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.306386:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179040 00010000:00010000:1.0:1721219371.306392:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a8e expref: 19 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:2.0:1721219371.306397:0:2850:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137124280 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2850:1804827459599488:0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219371.306403:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.306406:0:6715:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599616 00010000:00010000:3.0:1721219371.306411:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 8 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.306419:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137125a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599680:192.168.201.58@tcp:104: 00000100:00100000:0.0:1721219371.306421:0:6715:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00010000:00010000:1.0:1721219371.306425:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1721219371.306433:0:6715:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880137122ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15354:x1804827459599616:12345-0@lo:104: 00010000:00010000:3.0:1721219371.306462:0:15354:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.306469:0:6715:0:(ldlm_lockd.c:2154:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1721219371.306495:0:15354:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 8 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.306503:0:15354:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123dc0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599744:192.168.201.58@tcp:104: 00000100:00100000:1.0:1721219371.306508:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc8e40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:2852:x1804827459599552:12345-0@lo:103:ldlm_bl_01.0 Request processed in 115us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.306514:0:6715:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880137122ac0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+3:15354:x1804827459599616:12345-0@lo:104: Request processed in 80us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219371.306520:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179041 00000100:00100000:0.0:1721219371.306520:0:6715:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1721219371.306521:0:15354:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801350c5e40 going to sleep for 6 seconds 00010000:00010000:3.0:1721219371.306535:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001adb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001ad4 expref: 17 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.306549:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459598848:0@lo:104: 00000100:00100000:0.0:1721219371.306549:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459599552:0@lo:103:ldlm_bl_01.0 00010000:00010000:3.0:1721219371.306560:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5440/0xd4836d281e001acd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001ac6 expref: 16 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306569:0:6721:0:(ldlm_lockd.c:2784:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1721219371.306571:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343dd580 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459598912:0@lo:104: 00010000:00010000:1.0:1721219371.306575:0:6721:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.306582:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e7180/0xd4836d281e001abf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001ab8 expref: 15 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306585:0:6721:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff880091e0cd80 already unused, calling callback (ffffffffa0aca5c0) 10000000:00010000:1.0:1721219371.306588:0:6721:0:(mgc_request.c:1019:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219371.306597:0:6721:0:(ldlm_request.c:1235:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:00010000:1.0:1721219371.306606:0:6721:0:(mgc_request.c:1025:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219371.306612:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343db900 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459598976:0@lo:104: 10000000:01000000:1.0:1721219371.306614:0:6721:0:(mgc_request.c:1029:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1721219371.306629:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e7cc0/0xd4836d281e001ab1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001aaa expref: 14 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306639:0:6721:0:(ldlm_request.c:1301:ldlm_cancel_pack()) ### packing ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219371.306641:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343ddf00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599040:0@lo:104: 00010000:00010000:1.0:1721219371.306648:0:6721:0:(ldlm_request.c:1305:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1721219371.306651:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5680/0xd4836d281e001aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a9c expref: 13 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:3.0:1721219371.306661:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8801343d97c0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599104:0@lo:104: 00010000:00010000:1.0:1721219371.306663:0:6721:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.306670:0:2852:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459599808:0@lo:103:ldlm_bl_02.0 00010000:00010000:3.0:1721219371.306671:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e6640/0xd4836d281e001a95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a8e expref: 12 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306672:0:6721:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff880091e0cd80/0xd4836d281e001a80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000000 nid: local remote: 0xd4836d281e001a87 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:3.0:1721219371.306681:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137124c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599424:0@lo:104: 00000100:00100000:3.0:1721219371.306693:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137121c80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599616:0@lo:104: 00000100:00100000:0.0:1721219371.306693:0:2852:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1721219371.306698:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219371.306700:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219371.306702:0:6721:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1721219371.306717:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599808 00010000:00010000:1.0:1721219371.306733:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a80 expref: 12 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:1.0:1721219371.306757:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179042 00000100:00100000:1.0:1721219371.306763:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc9300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:2852:x1804827459599808:12345-0@lo:103:ldlm_bl_02.0 00010000:00010000:1.0:1721219371.306773:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219371.306777:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd4836d281e001a80 expref: 12 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306788:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd4836d281e001a80 expref: 12 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306801:0:25696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e4000/0xd4836d281e001a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd4836d281e001a80 expref: 12 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.306814:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1721219371.306868:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc9300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:2852:x1804827459599808:12345-0@lo:103:ldlm_bl_02.0 Request processed in 103us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1721219371.306878:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179042 00000100:00100000:0.0:1721219371.306903:0:2852:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f62600 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:2852:1804827459599808:0@lo:103:ldlm_bl_02.0 00000100:00100000:3.0:1721219371.308194:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137125a40 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599680:192.168.201.58@tcp:104: 00000100:00100000:3.0:1721219371.308205:0:15354:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123dc0 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:15354:1804827459599744:192.168.201.58@tcp:104: 00010000:00010000:3.0:1721219371.308274:0:15354:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.308284:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1721219371.308329:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219371.308407:0:25696:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268480 00010000:00010000:1.0:1721219371.308431:0:25696:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 9 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:2.0:1721219371.308451:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268544 00000100:00100000:1.0:1721219371.308499:0:25696:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179043 00000100:00100000:1.0:1721219371.308505:0:25696:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bc97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1834:x1804827511268480:12345-192.168.201.58@tcp:103:ldlm_bl_05.0 00010000:00010000:2.0:1721219371.308517:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 10 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.308524:0:25696:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219371.308530:0:25696:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 10 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:1.0:1721219371.308540:0:25696:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 10 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:2.0:1721219371.308544:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179044 00000100:00100000:2.0:1721219371.308550:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a66f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+10:1835:x1804827511268544:12345-192.168.201.58@tcp:103:ldlm_bl_02.0 00010000:00010000:1.0:1721219371.308552:0:25696:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001a79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b32 expref: 10 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:2.0:1721219371.308560:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219371.308562:0:25696:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219371.308565:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 9 pid: 27116 timeout: 1917 lvb_type: 0 00010000:00010000:2.0:1721219371.308589:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 9 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:1.0:1721219371.308595:0:25696:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bc97c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_007:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:1834:x1804827511268480:12345-192.168.201.58@tcp:103:ldlm_bl_05.0 Request processed in 90us (315us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219371.308601:0:8342:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff88008c8e5d40/0xd4836d281e001a72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b2b expref: 9 pid: 27116 timeout: 1917 lvb_type: 0 00000100:00100000:1.0:1721219371.308604:0:25696:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179043 00010000:00010000:2.0:1721219371.308614:0:8342:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308620:0:8342:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308631:0:8342:0:(ldlm_lock.c:942:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308637:0:8342:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308642:0:8342:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308647:0:8342:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308652:0:8342:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a5451200 already unused, calling callback (ffffffffa0815190) 00010000:00010000:2.0:1721219371.308655:0:8342:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308660:0:8342:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308671:0:8342:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.308686:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1721219371.308691:0:15354:0:(ldlm_request.c:199:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.308703:0:15354:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.308709:0:15354:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8800a5451200/0xd4836d281e001ae2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 15354 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.308732:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a66f4050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:1835:x1804827511268544:12345-192.168.201.58@tcp:103:ldlm_bl_02.0 Request processed in 180us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.308741:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179044 10000000:01000000:0.0:1721219371.833595:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219371.833601:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff8800a6512800 from 121 10000000:01000000:0.0:1721219371.833606:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219371.833649:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.833660:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.833688:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.833712:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459599872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.833778:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.833813:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.833917:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599872 00000100:00100000:2.0:1721219371.833980:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1093 00000100:00100000:2.0:1721219371.833986:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+11:6729:x1804827459599872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219371.834001:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219371.834016:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e6640/0xd4836d281e001af0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001ae9 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.834039:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e6640/0xd4836d281e001af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001ae9 expref: 12 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.834049:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e6640/0xd4836d281e001af0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001ae9 expref: 12 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.834057:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e6640, rc 0) 00000100:00100000:2.0:1721219371.834111:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e92850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459599872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.834119:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1093 00000100:00100000:0.0:1721219371.834141:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459599872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219371.834156:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001af0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.834165:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001af0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.834217:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459599936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.834272:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.834293:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.834323:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459599936 00000100:00100000:2.0:1721219371.834344:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1094 00000100:00100000:2.0:1721219371.834348:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459599936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.834552:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e91850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459599936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 199us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.834563:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1094 00000100:00100000:0.0:1721219371.834577:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459599936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.834606:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.834646:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.834657:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.834673:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600000 00000100:00100000:2.0:1721219371.834700:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1095 00000100:00100000:2.0:1721219371.834706:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880099e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459600000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.834943:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880099e91050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459600000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 235us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.834951:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1095 00000100:00100000:0.0:1721219371.834970:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219371.835266:0:15357:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15357:1804827459600064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.835343:0:15357:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.835380:0:15357:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013270f600 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.835407:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600064 00000100:00100000:2.0:1721219371.835437:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1096 00000100:00100000:2.0:1721219371.835440:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15357:x1804827459600064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219371.835844:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d34050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15357:x1804827459600064:12345-0@lo:502:llog_process_th.0 Request processed in 401us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.835852:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1096 00000100:00100000:1.0:1721219371.835915:0:15357:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15357:1804827459600064:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.835979:0:15357:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15357:1804827459600128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.836032:0:15357:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.836068:0:15357:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4a80 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.836088:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600128 00000100:00100000:2.0:1721219371.836119:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1097 00000100:00100000:2.0:1721219371.836122:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15357:x1804827459600128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219371.836376:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d37050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:15357:x1804827459600128:12345-0@lo:502:llog_process_th.0 Request processed in 251us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.836384:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1097 00000100:00100000:1.0:1721219371.836440:0:15357:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15357:1804827459600128:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219371.836549:0:15357:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 124 count 123 00000020:01000000:0.0:1721219371.836622:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 121-123 (rc=0) 10000000:01000000:0.0:1721219371.836646:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219371.836651:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001af0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.836671:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0e640/0xd4836d281e001ae9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001af0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219371.836679:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1721219371.836681:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 117 10000000:01000000:0.0:1721219371.836683:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1721219371.836697:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.836703:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.836709:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.836720:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.836748:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.836773:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.836792:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600192 00000100:00100000:2.0:1721219371.836813:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1098 00000100:00100000:2.0:1721219371.836816:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+12:6729:x1804827459600192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219371.836823:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219371.836832:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5680/0xd4836d281e001afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001af7 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.836846:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5680/0xd4836d281e001afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001af7 expref: 13 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.836862:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5680/0xd4836d281e001afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001af7 expref: 13 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.836868:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5680, rc 0) 00000100:00100000:2.0:1721219371.836910:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459600192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.836916:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1098 00000100:00100000:0.0:1721219371.836948:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219371.836958:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001afe expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.836965:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001afe expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.837000:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.837023:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.837046:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.837070:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600256 00000100:00100000:2.0:1721219371.837089:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1099 00000100:00100000:2.0:1721219371.837093:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459600256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.837181:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d33050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459600256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 87us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.837188:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1099 00000100:00100000:0.0:1721219371.837204:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.837261:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.837298:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.837310:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.837319:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600320 00000100:00100000:2.0:1721219371.837343:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1100 00000100:00100000:2.0:1721219371.837347:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459600320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.837567:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d34850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459600320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 218us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.837575:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1100 00000100:00100000:0.0:1721219371.837595:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219371.837876:0:15358:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15358:1804827459600384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.837942:0:15358:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.837976:0:15358:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013270f600 going to sleep for 6 seconds 00000100:00100000:2.0:1721219371.838005:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600384 00000100:00100000:2.0:1721219371.838036:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1101 00000100:00100000:2.0:1721219371.838039:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15358:x1804827459600384:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219371.838423:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15358:x1804827459600384:12345-0@lo:502:llog_process_th.0 Request processed in 382us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.838431:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1101 00000100:00100000:1.0:1721219371.838496:0:15358:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15358:1804827459600384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1721219371.838529:0:15358:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1721219371.838537:0:15358:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1721219371.838538:0:15358:0:(obd_config.c:1460:class_process_config()) marker 77 (0x1) lustre-MDT0000-m add lustre.test_22d.lustre-OST0000_UUID 00000020:00000080:1.0:1721219371.838544:0:15358:0:(obd_config.c:1384:class_process_config()) processing cmd: ce021 00020000:01000000:1.0:1721219371.838558:0:15358:0:(lod_pool.c:614:lod_pool_add()) Added lustre-OST0000_UUID to test_22d as member 1 00000020:01000004:1.0:1721219371.838784:0:15359:0:(obd_mount_server.c:167:server_get_mount()) get mount ffff8800a6512800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1721219371.838788:0:15359:0:(obd_mount.c:668:lustre_put_lsi()) put ffff8800a6512800 4 00000100:00100000:2.0:1721219371.838818:0:15358:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15358:1804827459600448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1721219371.838857:0:15358:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.838885:0:15358:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.838937:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600448 00000100:00100000:3.0:1721219371.838978:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1102 00000100:00100000:3.0:1721219371.838984:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15358:x1804827459600448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.839274:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d33850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:15358:x1804827459600448:12345-0@lo:502:llog_process_th.0 Request processed in 289us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219371.839287:0:15358:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15358:1804827459600448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.839295:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1102 00000020:01000000:2.0:1721219371.839318:0:15358:0:(obd_config.c:1789:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1721219371.839323:0:15358:0:(obd_config.c:1384:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1721219371.839324:0:15358:0:(obd_config.c:1460:class_process_config()) marker 77 (0x2) lustre-MDT0000-m add lustre.test_22d.lustre-OST0000_UUID 00000040:00080000:2.0:1721219371.839328:0:15358:0:(llog.c:773:llog_process_thread()) stop processing plain 0x4:10:0 index 120 count 118 00000020:01000000:0.0:1721219371.839400:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-MDT0000 gen 117-119 (rc=0) 10000000:01000000:0.0:1721219371.839425:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1721219371.839429:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001afe expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.839439:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0d8c0/0xd4836d281e001af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001afe expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219371.839448:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1721219371.839450:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff880136319800 from 121 10000000:01000000:0.0:1721219371.839452:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1721219371.839503:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.839510:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.839517:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.839531:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.839566:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.839594:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.839624:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600512 00000100:00100000:3.0:1721219371.839657:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1103 00000100:00100000:3.0:1721219371.839661:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+13:6729:x1804827459600512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219371.839669:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219371.839678:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a5451200/0xd4836d281e001b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001b05 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.839696:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5451200/0xd4836d281e001b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001b05 expref: 14 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.839703:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a5451200/0xd4836d281e001b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001b05 expref: 14 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.839710:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5451200, rc 0) 00000100:00100000:3.0:1721219371.839755:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d32850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459600512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.839761:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1103 00000100:00100000:0.0:1721219371.839789:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219371.839814:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b0c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.839823:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b0c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.839864:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.839891:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.839917:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.839943:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600576 00000100:00100000:3.0:1721219371.839961:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1104 00000100:00100000:3.0:1721219371.839965:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459600576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.840059:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d30050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459600576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.840066:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1104 00000100:00100000:0.0:1721219371.840088:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.840113:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.840151:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.840175:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.840200:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600640 00000100:00100000:3.0:1721219371.840217:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1105 00000100:00100000:3.0:1721219371.840221:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459600640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.840410:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d30850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459600640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.840417:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1105 00000100:00100000:0.0:1721219371.840441:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219371.840741:0:15360:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15360:1804827459600704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.840797:0:15360:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.840829:0:15360:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4a80 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.840849:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600704 00000100:00100000:3.0:1721219371.840878:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1106 00000100:00100000:3.0:1721219371.840882:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15360:x1804827459600704:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.841179:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d31050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15360:x1804827459600704:12345-0@lo:502:llog_process_th.0 Request processed in 295us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.841186:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1106 00000100:00100000:1.0:1721219371.841263:0:15360:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15360:1804827459600704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.841318:0:15360:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15360:1804827459600768:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1721219371.841357:0:15360:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.841384:0:15360:0:(client.c:2492:ptlrpc_set_wait()) set ffff88013270f600 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.841411:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600768 00000100:00100000:3.0:1721219371.841440:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1107 00000100:00100000:3.0:1721219371.841443:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15360:x1804827459600768:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.841726:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d31850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:15360:x1804827459600768:12345-0@lo:502:llog_process_th.0 Request processed in 280us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.841733:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1107 00000100:00100000:1.0:1721219371.841832:0:15360:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15360:1804827459600768:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1721219371.841867:0:15360:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 124 count 123 00000020:01000000:0.0:1721219371.842002:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 121-123 (rc=0) 10000000:01000000:0.0:1721219371.842026:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1721219371.842031:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b0c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.842041:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0fa80/0xd4836d281e001b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b0c expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:0.0:1721219371.842050:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1721219371.842052:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 11 10000000:01000000:0.0:1721219371.842054:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1721219371.842071:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.842090:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.842098:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219371.842112:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.842146:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1721219371.842177:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800a683a480 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.842293:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600832 00000100:00100000:3.0:1721219371.842325:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1108 00000100:00100000:3.0:1721219371.842329:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+14:6729:x1804827459600832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219371.842339:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219371.842349:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a5451d40/0xd4836d281e001b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001b13 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.842366:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5451d40/0xd4836d281e001b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001b13 expref: 15 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.842374:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a5451d40/0xd4836d281e001b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001b13 expref: 15 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.842381:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5451d40, rc 0) 00000100:00100000:3.0:1721219371.842435:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d32050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459600832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.842456:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1108 00000100:00100000:1.0:1721219371.842499:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff8800a8bc9c80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1721219371.842514:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b1a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219371.842524:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b1a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219371.842566:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219371.842600:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.842639:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4a80 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.842664:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600896 00000100:00100000:3.0:1721219371.842695:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1109 00000100:00100000:3.0:1721219371.842699:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459600896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.842798:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d36850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459600896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 97us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.842805:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1109 00000100:00100000:1.0:1721219371.842822:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1721219371.842849:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1721219371.842887:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1721219371.842900:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff8800b1ef4a80 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.842908:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459600960 00000100:00100000:3.0:1721219371.842928:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1110 00000100:00100000:3.0:1721219371.842932:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459600960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.843132:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d36050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459600960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 198us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.843139:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1110 00000100:00100000:1.0:1721219371.843159:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880098f64740 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459600960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1721219371.844338:0:15361:0:(llog.c:773:llog_process_thread()) stop processing plain 0x9:10:0 index 64768 count 11 00000020:01000000:2.0:1721219371.844501:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0001 gen 11-10 (rc=0) 10000000:01000000:2.0:1721219371.844524:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1721219371.844529:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b1a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.844539:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff880091e0df80/0xd4836d281e001b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b1a expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219371.844548:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1721219371.844550:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-client-ffff88009928e000 from 121 10000000:01000000:2.0:1721219371.844552:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1721219371.844570:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.844577:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.844584:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.844597:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.844631:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.844673:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.844761:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601024 00000100:00100000:3.0:1721219371.844806:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1111 00000100:00100000:3.0:1721219371.844811:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff880091d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+15:6729:x1804827459601024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1721219371.844821:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:3.0:1721219371.844831:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8800a5451440/0xd4836d281e001b28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001b21 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.844849:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8800a5451440/0xd4836d281e001b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001b21 expref: 16 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.844857:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8800a5451440/0xd4836d281e001b28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001b21 expref: 16 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219371.844863:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a5451440, rc 0) 00000100:00100000:3.0:1721219371.844923:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff880091d35850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459601024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.844930:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1111 00000100:00100000:2.0:1721219371.844960:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219371.844974:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b28 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.844982:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b28 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.845025:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.845051:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.845077:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.845107:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601088 00000100:00100000:3.0:1721219371.845137:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1112 00000100:00100000:3.0:1721219371.845141:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459601088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.845255:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459601088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 112us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.845262:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1112 00000100:00100000:2.0:1721219371.845287:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.845325:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.845378:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.845395:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:3.0:1721219371.845401:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601152 00000100:00100000:3.0:1721219371.845424:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1113 00000100:00100000:3.0:1721219371.845428:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459601152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.845627:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459601152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 197us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1721219371.845634:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1113 00000100:00100000:2.0:1721219371.845678:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1721219371.845908:0:15362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15362:1804827459601216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.845949:0:15362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219371.845976:0:15362:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31f00 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.846004:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601216 00000100:00100000:0.0:1721219371.846035:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1114 00000100:00100000:0.0:1721219371.846041:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15362:x1804827459601216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219371.846397:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15362:x1804827459601216:12345-0@lo:502:llog_process_th.0 Request processed in 355us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.846406:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1114 00000100:00100000:3.0:1721219371.846520:0:15362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15362:1804827459601216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.846575:0:15362:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff880137123dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15362:1804827459601280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1721219371.846618:0:15362:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1721219371.846651:0:15362:0:(client.c:2492:ptlrpc_set_wait()) set ffff880088d31f00 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.846678:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601280 00000100:00100000:0.0:1721219371.846709:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1115 00000100:00100000:0.0:1721219371.846713:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15362:x1804827459601280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1721219371.846934:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:15362:x1804827459601280:12345-0@lo:502:llog_process_th.0 Request processed in 219us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.846942:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1115 00000100:00100000:3.0:1721219371.846969:0:15362:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff880137123dc0 pname:cluuid:pid:xid:nid:opc:job llog_process_th:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:15362:1804827459601280:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1721219371.846997:0:15362:0:(llog.c:773:llog_process_thread()) stop processing plain 0x3:10:0 index 124 count 123 00000020:01000000:2.0:1721219371.847062:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-client gen 121-123 (rc=0) 10000000:01000000:2.0:1721219371.847083:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1721219371.847087:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b28 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.847095:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e7cc0/0xd4836d281e001b21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b28 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219371.847102:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1721219371.847104:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 14 10000000:01000000:2.0:1721219371.847106:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1721219371.847121:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.847134:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.847141:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.847154:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.847183:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.847209:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.847255:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601344 00000100:00100000:0.0:1721219371.847277:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1116 00000100:00100000:0.0:1721219371.847281:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+16:6729:x1804827459601344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219371.847288:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219371.847305:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0d440/0xd4836d281e001b36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001b2f expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.847322:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0d440/0xd4836d281e001b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001b2f expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.847330:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0d440/0xd4836d281e001b36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001b2f expref: 17 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.847337:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0d440, rc 0) 00000100:00100000:0.0:1721219371.847367:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459601344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.847373:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1116 00000100:00100000:2.0:1721219371.847379:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219371.847390:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b36 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.847397:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b36 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.847433:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.847455:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.847466:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.847498:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601408 00000100:00100000:0.0:1721219371.847516:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1117 00000100:00100000:0.0:1721219371.847519:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459601408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.847595:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459601408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.847601:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1117 00000100:00100000:2.0:1721219371.847606:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.847628:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601472:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.847664:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.847674:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.847682:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601472 00000100:00100000:0.0:1721219371.847696:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1118 00000100:00100000:0.0:1721219371.847699:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459601472:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.847870:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459601472:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.847877:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1118 00000100:00100000:2.0:1721219371.847880:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601472:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1721219371.848700:0:15363:0:(llog.c:773:llog_process_thread()) stop processing plain 0x8:10:0 index 64768 count 14 00000020:01000000:2.0:1721219371.848832:0:6729:0:(obd_config.c:2041:class_config_parse_llog()) Processed log lustre-OST0000 gen 14-13 (rc=0) 10000000:01000000:2.0:1721219371.848865:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1721219371.848870:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b36 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.848880:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e7180/0xd4836d281e001b2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b36 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 10000000:01000000:2.0:1721219371.848893:0:6729:0:(mgc_request.c:609:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1721219371.848896:0:6729:0:(mgc_request.c:2064:mgc_process_log()) Process log lustre-sptlrpc-ffff8800a6c10000 from 1 10000000:01000000:2.0:1721219371.848899:0:6729:0:(mgc_request.c:1102:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1721219371.848920:0:6729:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.848930:0:6729:0:(ldlm_request.c:1029:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.848941:0:6729:0:(ldlm_request.c:1117:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.848961:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.849005:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.849042:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.849130:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601536 00000100:00100000:0.0:1721219371.849162:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1119 00000100:00100000:0.0:1721219371.849167:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+17:6729:x1804827459601536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1721219371.849185:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:0.0:1721219371.849195:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff880091e0ef40/0xd4836d281e001b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd4836d281e001b3d expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.849212:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff880091e0ef40/0xd4836d281e001b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd4836d281e001b3d expref: 18 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.849220:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff880091e0ef40/0xd4836d281e001b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd4836d281e001b3d expref: 18 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:0.0:1721219371.849226:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff880091e0ef40, rc 0) 00000100:00100000:0.0:1721219371.849288:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459601536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1721219371.849295:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1119 00000100:00100000:2.0:1721219371.849300:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219371.849314:0:6729:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b44 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.849322:0:6729:0:(ldlm_request.c:799:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd4836d281e001b44 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00000100:00100000:2.0:1721219371.849361:0:6729:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219371.849400:0:6729:0:(events.c:361:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1721219371.849413:0:6729:0:(client.c:2492:ptlrpc_set_wait()) set ffff88009917c540 going to sleep for 6 seconds 00000100:00100000:0.0:1721219371.849421:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827459601600 00000100:00100000:0.0:1721219371.849438:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1120 00000100:00100000:0.0:1721219371.849442:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459601600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.849557:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4+18:6729:x1804827459601600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 111us (155us total) trans 0 rc -2/-2 00000100:00100000:2.0:1721219371.849563:0:6729:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:e4213324-d1e3-4cc5-a2fa-2ff18a7c56c4:6729:1804827459601600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1721219371.849568:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1120 10000000:01000000:2.0:1721219371.849587:0:6729:0:(mgc_request.c:2136:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1721219371.849592:0:6729:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b44 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219371.849599:0:6729:0:(ldlm_lock.c:909:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff88008c8e5440/0xd4836d281e001b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd4836d281e001b44 expref: -99 pid: 6729 timeout: 0 lvb_type: 0 00010000:00010000:3.0:1721219372.189722:0:9818:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1721219373.191726:0:8341:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1721219373.227797:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.227887:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268608 00000100:00100000:2.0:1721219373.227949:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1121 00000100:00100000:2.0:1721219373.227955:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+7:4616:x1804827511268608:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219373.227972:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219373.227988:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001b4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b39 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.228020:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b39 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.228031:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e5b00/0xd4836d281e001b4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b39 expref: 8 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.228039:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5b00, rc 0) 00000100:00100000:2.0:1721219373.228101:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268608:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 145us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.228109:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1121 00000100:00100000:0.0:1721219373.229117:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.229266:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268672 00000100:00100000:2.0:1721219373.229325:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1122 00000100:00100000:2.0:1721219373.229331:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268672:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219373.229500:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268672:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 139us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.229509:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1122 00000100:00100000:0.0:1721219373.230356:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.230504:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268736 00000100:00100000:2.0:1721219373.230549:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1123 00000100:00100000:2.0:1721219373.230555:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268736:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1721219373.230823:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268736:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 265us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.230832:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1123 00000100:00100000:0.0:1721219373.231850:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.231976:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268800 00000100:00100000:2.0:1721219373.232021:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1124 00000100:00100000:2.0:1721219373.232027:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23412:x1804827511268800:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1721219373.232447:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6bd3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23412:x1804827511268800:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 419us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.232455:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1124 00000100:00100000:0.0:1721219373.233555:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.233653:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268864 00000100:00100000:2.0:1721219373.233702:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1125 00000100:00100000:2.0:1721219373.233711:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23412:x1804827511268864:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1721219373.233940:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:23412:x1804827511268864:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 229us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.233949:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1125 00000100:00100000:0.0:1721219373.235691:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.235820:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268928 00000100:00100000:2.0:1721219373.235876:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1126 00000100:00100000:2.0:1721219373.235882:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+8:4616:x1804827511268928:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1721219373.235892:0:27116:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219373.235902:0:27116:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001b52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b40 expref: -99 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.235924:0:27116:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b40 expref: 9 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.235938:0:27116:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff88008c8e46c0/0xd4836d281e001b52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b40 expref: 9 pid: 27116 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.235948:0:27116:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e46c0, rc 0) 00000100:00100000:2.0:1721219373.235993:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511268928:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 108us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.236005:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1126 00000100:00100000:0.0:1721219373.237351:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.237504:0:27116:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511268992 00000100:00100000:2.0:1721219373.237549:0:27116:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1127 00000100:00100000:2.0:1721219373.237555:0:27116:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a6c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511268992:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1721219373.237635:0:27116:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a6c61850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:895aa51d-428d-41b3-8fd7-a0b7d3b7fe38+9:4616:x1804827511268992:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 79us (288us total) trans 0 rc -2/-2 00000100:00100000:2.0:1721219373.237644:0:27116:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1127 00000100:00100000:0.0:1721219373.678844:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.679008:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511269056 00000100:00100000:2.0:1721219373.679075:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 349 00000100:00100000:2.0:1721219373.679082:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bcd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+63:23423:x1804827511269056:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1721219373.679104:0:30055:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219373.679124:0:30055:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001b59 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b47 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679196:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679257:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679268:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679287:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679293:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679299:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679550:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001b6e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679564:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679575:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1721219373.679629:0:30055:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6a19:0x0]: returning size 11776 00000004:00200000:2.0:1721219373.679635:0:30055:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1721219373.679671:0:30055:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001b6e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679685:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679695:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679706:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679716:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6880 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219373.679731:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679742:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679759:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff88008ea0ce00) 00010000:00010000:2.0:1721219373.679764:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219373.679767:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679777:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679817:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679827:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679844:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679850:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5f80 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219373.679853:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679859:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679867:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x9516acfe (ffff8801333d7100) 00010000:00010000:2.0:1721219373.679869:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219373.679871:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679876:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5f80/0xd4836d281e001b67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x9516acfe bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679910:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4000/0xd4836d281e001b59 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b47 expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679922:0:30055:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001b6e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b47 expref: 64 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.679929:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a19:0x0].0x0 (ffff8801333d7000) 00010000:00010000:2.0:1721219373.679931:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1721219373.679932:0:30055:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e5d40, rc 0) 00010000:00000080:2.0:1721219373.679938:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bcd0c0 x1804827511269056/t0(0) o101->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:663/0 lens 584/640 e 0 to 0 dl 1721219463 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1721219373.680014:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bcd0c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:23423:x1804827511269056:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 931us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1721219373.680023:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 349 00000100:00100000:0.0:1721219373.681552:0:2844:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.681674:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511269120 00000100:00100000:2.0:1721219373.681721:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 350 00000100:00100000:2.0:1721219373.681727:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bcd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:23423:x1804827511269120:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1721219373.681740:0:30055:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219373.681751:0:30055:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e61c0/0xd4836d281e001b75 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b4e expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681787:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681797:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681805:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681816:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681822:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681828:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681906:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681913:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681918:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681924:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e5200 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219373.681926:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681932:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681941:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a19:0x0].0x0 (ffff8801333d7000) 00010000:00010000:2.0:1721219373.681943:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219373.681945:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681951:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5200/0xd4836d281e001b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681960:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681966:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681983:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.681999:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6ac0 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219373.682001:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.682007:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.682013:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a19:0x0].0x9516ad10 (ffff8801333d7e00) 00010000:00010000:2.0:1721219373.682016:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219373.682017:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.682022:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6ac0/0xd4836d281e001b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.682063:0:30055:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e61c0/0xd4836d281e001b75 lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b4e expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.682070:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e61c0/0xd4836d281e001b75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b4e expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.682077:0:30055:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff88008c8e61c0, rc 0) 00010000:00000080:2.0:1721219373.682082:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bcd580 x1804827511269120/t0(0) o101->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:663/0 lens 584/640 e 0 to 0 dl 1721219463 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:2.0:1721219373.682136:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bcd580 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:23423:x1804827511269120:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 408us (588us total) trans 0 rc 301/301 00000100:00100000:2.0:1721219373.682151:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 350 00000100:00100000:0.0:1721219373.684023:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.684141:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511269248 00000100:00100000:2.0:1721219373.684187:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 351 00000100:00100000:2.0:1721219373.684192:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:23423:x1804827511269248:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1721219373.684227:0:30055:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219373.684229:0:30055:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1721219373.684246:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e5d40/0xd4836d281e001b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6a19:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b47 expref: 64 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684262:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a19:0x0].0x0 (ffff8801333d7000) 00010000:00010000:2.0:1721219373.684269:0:30055:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219373.684277:0:30055:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4fc0/0xd4836d281e001b8a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b55 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684373:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684383:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684391:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684401:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684407:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.684429:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685089:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685100:0:30055:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685108:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000004:00200000:2.0:1721219373.685116:0:30055:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6a1a:0x0]: returning size 0 00010000:00010000:2.0:1721219373.685135:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685141:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685147:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685152:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff88008c8e6880 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219373.685155:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685160:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685181:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a19:0x0].0x0 (ffff8801333d7700) 00010000:00010000:2.0:1721219373.685184:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1721219373.685186:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685192:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e6880/0xd4836d281e001b91 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000004:00010000:2.0:1721219373.685232:0:30055:0:(mdt_handler.c:3997:mdt_save_lock()) ### save lock request ffff8800a8bcda40 reply state ffff880088ec0000 transno 12884902032 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685260:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff88008c8e4fc0/0xd4836d281e001b8a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 66 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685274:0:30055:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.685280:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a1a:0x0].0x0 (ffff8801333d7500) 00010000:00010000:2.0:1721219373.685282:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1721219373.685283:0:30055:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a6c31f80, rc 0) 00010000:00000080:2.0:1721219373.685288:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bcda40 x1804827511269248/t12884902032(0) o101->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:663/0 lens 528/600 e 0 to 0 dl 1721219463 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1721219373.685345:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bcda40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+66:23423:x1804827511269248:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1152us (1325us total) trans 12884902032 rc 0/0 00000100:00100000:2.0:1721219373.685354:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 351 00010000:00010000:1.0:1721219373.686432:0:2835:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.686449:0:2835:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.686461:0:2835:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.686525:0:2835:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a6c32d00 already unused, calling callback (ffffffffa1356360) 00010000:00010000:1.0:1721219373.686530:0:2835:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.686541:0:2835:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.686558:0:2835:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a19:0x0].0x9516ad10 (ffff8801333d7600) 00010000:00010000:1.0:1721219373.686562:0:2835:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1721219373.686566:0:2835:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.686597:0:2835:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c32d00/0xd4836d281e001b98 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6a19:0x0].0x9516ad10 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219373.686712:0:2843:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.686792:0:30055:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511269376 00000100:00100000:2.0:1721219373.686832:0:30055:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 352 00000100:00100000:2.0:1721219373.686845:0:30055:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bcdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+65:23423:x1804827511269376:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1721219373.686858:0:30055:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START 00010000:00010000:2.0:1721219373.686868:0:30055:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c30fc0/0xd4836d281e001bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe0b47d8ca5f72b5c expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.686915:0:30055:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.686926:0:30055:0:(ldlm_lock.c:675:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 66 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.686933:0:30055:0:(ldlm_resource.c:1649:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.686965:0:30055:0:(ldlm_lockd.c:953:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 66 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.686977:0:30055:0:(ldlm_lockd.c:489:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 66 pid: 30055 timeout: 1919 lvb_type: 0 00000100:00100000:2.0:1721219373.686989:0:30055:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:30055:1804827459601664:192.168.201.58@tcp:104: 00000100:00100000:2.0:1721219373.687049:0:30055:0:(client.c:2492:ptlrpc_set_wait()) set ffff8801350c5300 going to sleep for 6 seconds 00000100:00100000:2.0:1721219373.688679:0:30055:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@ffff88008bf150c0 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:30055:1804827459601664:192.168.201.58@tcp:104: 00010000:00010000:2.0:1721219373.688701:0:30055:0:(ldlm_request.c:286:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000100:00100000:0.0:1721219373.688716:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1721219373.688833:0:8342:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511269440 00010000:00010000:1.0:1721219373.688859:0:8342:0:(ldlm_lockd.c:2633:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 67 pid: 30055 timeout: 1919 lvb_type: 0 00000100:00100000:1.0:1721219373.688903:0:8342:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179045 00000100:00100000:1.0:1721219373.688909:0:8342:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff8800a8bce3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2df8dc7e-94ba-4991-a575-93aaf526cb45+67:1834:x1804827511269440:12345-192.168.201.58@tcp:103:ldlm_bl_03.0 00010000:00010000:1.0:1721219373.688920:0:8342:0:(ldlm_lockd.c:1721:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1721219373.688924:0:8342:0:(ldlm_lockd.c:1766:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 67 pid: 30055 timeout: 1919 lvb_type: 0 00010000:00010000:1.0:1721219373.688934:0:8342:0:(ldlm_lockd.c:562:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 67 pid: 30055 timeout: 1919 lvb_type: 0 00010000:00010000:1.0:1721219373.688949:0:8342:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31f80/0xd4836d281e001b9f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a1a:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b55 expref: 67 pid: 30055 timeout: 1919 lvb_type: 0 00010000:00010000:1.0:1721219373.688962:0:8342:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a1a:0x0].0x0 (ffff8801333d7500) 00010000:00010000:1.0:1721219373.688966:0:8342:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.688974:0:8342:0:(ldlm_lock.c:704:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.688991:0:8342:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:1.0:1721219373.689032:0:8342:0:(ldlm_lockd.c:1777:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1721219373.689051:0:30055:0:(ldlm_request.c:202:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219373.689072:0:8342:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bce3c0 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:2df8dc7e-94ba-4991-a575-93aaf526cb45+66:1834:x1804827511269440:12345-192.168.201.58@tcp:103:ldlm_bl_03.0 Request processed in 162us (360us total) trans 0 rc 0/0 00010000:00010000:2.0:1721219373.689076:0:30055:0:(ldlm_request.c:531:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00000100:00100000:1.0:1721219373.689080:0:8342:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179045 00000004:00200000:2.0:1721219373.689090:0:30055:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x200000401:0x6a1a:0x0]: returning size 0 00010000:00010000:2.0:1721219373.689176:0:30055:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689183:0:30055:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689189:0:30055:0:(ldlm_lockd.c:1874:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689195:0:30055:0:(ldlm_lockd.c:1888:ldlm_handle_bl_callback()) Lock ffff8800a6c31d40 already unused, calling callback (ffffffffa1356360) 00010000:00010000:2.0:1721219373.689197:0:30055:0:(ldlm_request.c:367:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689235:0:30055:0:(ldlm_request.c:1260:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689246:0:30055:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6a1a:0x0].0x0 (ffff8801333d7500) 00010000:00010000:2.0:1721219373.689249:0:30055:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1721219373.689251:0:30055:0:(ldlm_lockd.c:1898:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689257:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c31d40/0xd4836d281e001bb4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6a1a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689290:0:30055:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c30fc0/0xd4836d281e001bad lrc: 1/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b5c expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689306:0:30055:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8800a6c30fc0/0xd4836d281e001bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6a19:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xe0b47d8ca5f72b5c expref: 65 pid: 30055 timeout: 0 lvb_type: 0 00010000:00010000:2.0:1721219373.689318:0:30055:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock ffff8800a6c30fc0, rc 0) 00010000:00000080:2.0:1721219373.689323:0:30055:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff8800a8bcdf00 x1804827511269376/t0(0) o101->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:663/0 lens 1104/600 e 0 to 0 dl 1721219463 ref 1 fl Interpret:/0/0 rc 301/0 job:'lfs.0' 00000100:00100000:2.0:1721219373.689381:0:30055:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff8800a8bcdf00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:23423:x1804827511269376:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2535us (2672us total) trans 0 rc 301/301 00000100:00100000:2.0:1721219373.689389:0:30055:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 352 00000100:00100000:0.0:1721219373.690573:0:2842:0:(events.c:361:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1721219373.690650:0:28750:0:(service.c:2140:ptlrpc_server_handle_req_in()) got req x1804827511269568 00000100:00100000:2.0:1721219373.690700:0:28750:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1721219373.690706:0:28750:0:(service.c:2309:ptlrpc_server_handle_request()) Handling RPC req@ffff88012bd3d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+64:23423:x1804827511269568:12345-192.168.201.58@tcp:35:lfs.0 00010000:00000080:2.0:1721219373.690824:0:28750:0:(ldlm_lib.c:3181:target_committed_to_req()) @@@ not sending last_committed update (1/0) req@ffff88012bd3d850 x1804827511269568/t12884902033(0) o35->2df8dc7e-94ba-4991-a575-93aaf526cb45@192.168.201.58@tcp:579/0 lens 392/456 e 0 to 0 dl 1721219379 ref 1 fl Interpret:/0/0 rc 0/0 job:'lfs.0' 00000100:00100000:2.0:1721219373.690880:0:28750:0:(service.c:2358:ptlrpc_server_handle_request()) Handled RPC req@ffff88012bd3d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:2df8dc7e-94ba-4991-a575-93aaf526cb45+65:23423:x1804827511269568:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 174us (311us total) trans 12884902033 rc 0/0 00000100:00100000:2.0:1721219373.690889:0:28750:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000400:00000080:1.0:1721219374.138039:0:15497:0:(module.c:211:libcfs_ioctl()) libcfs ioctl cmd 3221775648 00000001:02000400:1.0:1721219374.138044:0:15497:0:(debug.c:728:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pfl test_22d: @@@@@@ FAIL: Create /mnt/lustre/d22d.sanity-pfl/f22d.sanity-pfl failed 00010000:00010000:3.0:1721219374.193650:0:9965:0:(ldlm_lockd.c:2787:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 4659 lines, 4659 kept, 0 dropped, 0 bad.