00010000:00010000:1.0F:1789892670.546794:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0F:1789892671.109168:0:217070:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffebf50d630 20000000:00000080:3.0:1789892671.109188:0:217070:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9031915df800 uarg=0000000000000000 00000040:00100000:3.0:1789892671.109733:0:217070:0:(llog.c:1072:llog_reverse_process()) index 173 : idx 137 20000000:01000000:3.0:1789892671.109741:0:217070:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 163 cmd:0xce021 lustre.qpool1 lustre-OST0000_UUID 20000000:01000000:3.0:1789892671.109756:0:217070:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892671.110008:0:217071:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 162 marker 174 1->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892671.110071:0:217071:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 164 marker 174 2->4: lustre-clilov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892671.110083:0:217071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 174 count 171 00000040:00080000:1.0:1789892671.110223:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].174, 224 off40008 20000000:01000000:1.0:1789892671.110237:0:217070:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892671.110248:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].175, 128 off40136 00000040:00080000:1.0:1789892671.110259:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].176, 224 off40360 20000000:01000000:1.0:1789892671.110269:0:217070:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892671.110543:0:217072:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 188 marker 175 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892671.110559:0:217072:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 190 marker 175 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892671.110568:0:217072:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 200 count 196 00000040:00080000:1.0:1789892671.110656:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].200, 224 off44816 20000000:01000000:1.0:1789892671.110681:0:217070:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892671.110724:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].201, 136 off44952 00000040:00080000:1.0:1789892671.110750:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].202, 224 off45176 20000000:01000000:1.0:1789892671.110764:0:217070:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0000_UUID fl=4 20000000:01000000:3.0:1789892671.110985:0:217073:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 188 marker 176 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 20000000:01000000:3.0:1789892671.111016:0:217073:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 190 marker 176 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892671.111045:0:217073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 200 count 196 00000040:00080000:1.0:1789892671.111131:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].200, 224 off44816 20000000:01000000:1.0:1789892671.111141:0:217070:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0000_UUID (null) 00000040:00080000:1.0:1789892671.111158:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].201, 136 off44952 00000040:00080000:1.0:1789892671.111177:0:217070:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].202, 224 off45176 10000000:01000000:1.0:1789892671.111189:0:217070:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892671.111213:0:217070:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111234:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111241:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111247:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111251:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111256:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111266:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111271:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111275:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111280:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111284:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111289:0:217070:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111294:0:217070:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111335:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111347:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 23 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.111362:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523072:0@lo:104: 00000100:00100000:1.0:1789892671.111429:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892671.111477:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523072 00000100:00100000:3.0:1789892671.111484:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523072 00010000:00010000:1.0:1789892671.111497:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111504:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 23 pid: 190662 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.111512:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523200:0@lo:104: 00000100:00100000:3.0:1789892671.111537:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 473 00000100:00100000:1.0:1789892671.111537:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892671.111548:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055523072:12345-0@lo:104: 00000100:00100000:0.0F:1789892671.111559:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523200 00010000:00010000:3.0:1789892671.111564:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111571:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.111571:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523200 00010000:00010000:1.0:1789892671.111582:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 23 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.111592:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523328:0@lo:104: 00000100:00100000:0.0:1789892671.111614:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 474 00000100:00100000:1.0:1789892671.111620:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892671.111626:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217070:x1876835055523200:12345-0@lo:104: 00010000:00010000:3.0:1789892671.111634:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789892671.111635:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0F:1789892671.111640:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789892671.111647:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217070:x1876835055523072:12345-0@lo:104: Request processed in 98us (214us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892671.111650:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.111659:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 473 00010000:00010000:1.0:1789892671.111660:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 23 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.111665:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523328 00000100:00100000:2.0:1789892671.111671:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523328 00000100:00100000:1.0:1789892671.111671:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308a295880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523456:0@lo:104: 00000100:00100000:2.0:1789892671.111718:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 475 00000100:00100000:2.0:1789892671.111728:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a1d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217070:x1876835055523328:12345-0@lo:104: 00010000:00010000:2.0:1789892671.111736:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.111753:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892671.111754:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892671.111762:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217070:x1876835055523200:12345-0@lo:104: Request processed in 140us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892671.111771:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 474 00010000:00010000:2.0:1789892671.111793:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892671.111796:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523456 00000100:00100000:0.0:1789892671.111801:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523456 00000100:00100000:2.0:1789892671.111802:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a1d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055523328:12345-0@lo:104: Request processed in 75us (182us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892671.111805:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.111819:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 475 00010000:00010000:1.0:1789892671.111821:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 23 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.111828:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 476 00000100:00100000:1.0:1789892671.111836:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319dcdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523584:0@lo:104: 00000100:00100000:0.0:1789892671.111840:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308a297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055523456:12345-0@lo:104: 00010000:00010000:0.0:1789892671.111851:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.111879:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892671.111899:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789892671.111901:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892671.111910:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308a297800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055523456:12345-0@lo:104: Request processed in 73us (157us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892671.111912:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.111917:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.111919:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 476 00000100:00100000:3.0:1789892671.111920:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523584 00000100:00100000:3.0:1789892671.111928:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523584 00010000:00010000:2.0:1789892671.111934:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ca00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892671.111939:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 23 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892671.111942:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.111943:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892671.111952:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.111964:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 477 00000100:00100000:1.0:1789892671.111968:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523712:0@lo:104: 00010000:00010000:2.0:1789892671.111973:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.111974:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382a00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892671.111975:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319dcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055523584:12345-0@lo:104: 10000000:00010000:0.0:1789892671.111979:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892671.112009:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112012:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.112012:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892671.112033:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892671.112034:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892671.112041:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892671.112048:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892671.112058:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892671.112061:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 23 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112072:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892671.112072:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903084f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523840:0@lo:104: 00010000:00010000:2.0:1789892671.112076:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112080:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112081:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319dcdea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055523584:12345-0@lo:104: Request processed in 104us (201us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892671.112092:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892671.112099:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892671.112100:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892671.112124:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112127:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112128:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112145:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 23 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112149:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af5f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5fe expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112151:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af5e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5f0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112176:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:1.0:1789892671.112178:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a2858380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524224:0@lo:104: 00010000:00010000:0.0:1789892671.112180:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789892671.112181:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112186:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112193:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9de00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892671.112196:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9da00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892671.112197:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892671.112201:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112206:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112209:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.112218:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892671.112222:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 477 10000000:00010000:2.0:1789892671.112223:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892671.112233:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892671.112234:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892671.112244:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523712 10000000:01000000:0.0:1789892671.112245:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892671.112246:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112249:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523712 00010000:00010000:1.0:1789892671.112258:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 23 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112264:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112270:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892671.112271:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523840 00010000:00010000:0.0:1789892671.112272:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112277:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523840 00010000:00010000:2.0:1789892671.112280:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112290:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055524224 00010000:00010000:0.0:1789892671.112295:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892671.112297:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055524224 00000100:00100000:1.0:1789892671.112297:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a285b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524352:0@lo:104: 00010000:00010000:2.0:1789892671.112303:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9de00/0xd5b980e0d62af5db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5e2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112308:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112314:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af5cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5d4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112318:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 478 00000100:00100000:3.0:1789892671.112332:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217070:x1876835055523712:12345-0@lo:104: 00000100:00100000:1.0:1789892671.112334:0:217070:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892671.112339:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892671.112343:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112344:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112344:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892671.112349:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892671.112352:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892671.112361:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892671.112363:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383c00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892671.112363:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892671.112369:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112370:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892671.112383:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112385:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 9 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892671.112393:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112395:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055524096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892671.112408:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:01000000:2.0:1789892671.112412:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892671.112419:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217070:x1876835055523712:12345-0@lo:104: Request processed in 88us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892671.112420:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524736:192.168.203.53@tcp:104: 00000100:00100000:3.0:1789892671.112427:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 478 00010000:00010000:2.0:1789892671.112430:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112435:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892671.112441:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112444:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055524352 00000100:00100000:0.0:1789892671.112447:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892671.112451:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055524352 00010000:00010000:2.0:1789892671.112454:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af5bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5c6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112465:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892671.112468:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112475:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 479 00000100:00100000:0.0:1789892671.112480:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1789892671.112487:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892671.112493:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112493:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055524480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892671.112494:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217070:x1876835055523840:12345-0@lo:104: 00010000:00010000:1.0:1789892671.112499:0:217070:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112509:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112514:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112520:0:217070:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 9 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112529:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:2.0:1789892671.112534:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892671.112546:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892671.112546:0:217070:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524992:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892671.112566:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055524096 00010000:00010000:2.0:1789892671.112570:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112570:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055524096 00010000:00010000:2.0:1789892671.112577:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892671.112581:0:217070:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213ab40 going to sleep for 11 seconds 00010000:00010000:3.0:1789892671.112591:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:0.0:1789892671.112594:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 24 pid: 190662 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112596:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112602:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084f2b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217070:x1876835055523840:12345-0@lo:104: Request processed in 112us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892671.112606:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523072:0@lo:104: 00010000:00010000:2.0:1789892671.112620:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af5b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5b8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112624:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 479 00000100:00100000:1.0:1789892671.112626:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523200:0@lo:104: 00000100:00100000:0.0:1789892671.112630:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055524480 00000100:00100000:0.0:1789892671.112635:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055524480 00010000:00010000:2.0:1789892671.112644:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892671.112648:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112651:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 480 00010000:00010000:0.0:1789892671.112651:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 25 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.112652:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523328:0@lo:104: 00010000:00010000:2.0:1789892671.112658:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892671.112664:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112666:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a2859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217070:x1876835055524224:12345-0@lo:104: 00000100:00100000:1.0:1789892671.112669:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308a295880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523456:0@lo:104: 00010000:00010000:2.0:1789892671.112710:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892671.112717:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112718:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.112721:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319dcdc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523584:0@lo:104: 10000000:01000000:2.0:1789892671.112729:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892671.112736:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1789892671.112738:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f28a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523712:0@lo:104: 00010000:00010000:2.0:1789892671.112749:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112749:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055524096:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892671.112755:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903084f29c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055523840:0@lo:104: 00010000:00010000:3.0:1789892671.112766:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892671.112767:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892671.112768:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892671.112775:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a2859880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217070:x1876835055524224:12345-0@lo:104: Request processed in 113us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892671.112775:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a2858380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524224:0@lo:104: 00010000:00010000:2.0:1789892671.112776:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112778:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 25 pid: 190662 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112797:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 480 00010000:00010000:2.0:1789892671.112798:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af5a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af5aa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.112804:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 25 pid: 190662 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112814:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892671.112818:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112820:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892671.112823:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af5f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5e9 expref: 25 pid: 190662 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112826:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 481 00010000:00010000:2.0:1789892671.112831:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892671.112837:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.112838:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1789892671.112842:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055524352:12345-0@lo:104: 00010000:00010000:0.0:1789892671.112846:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892671.112852:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055524480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892671.112854:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112859:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112867:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 10000000:00010000:2.0:1789892671.112870:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112875:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 24 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112876:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055524096:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892671.112895:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 10000000:01000000:2.0:1789892671.112896:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892671.112909:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 24 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112914:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892671.112918:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.112920:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217070:x1876835055524352:12345-0@lo:104: Request processed in 83us (591us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892671.112927:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892671.112927:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383600/0xd5b980e0d62af5e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5db expref: 23 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.112933:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055525248:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892671.112934:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 481 00010000:00010000:2.0:1789892671.112936:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112948:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d200/0xd5b980e0d62af595 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af59c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.112951:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892671.112961:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892671.112963:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892671.112965:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.112973:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892671.112973:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892671.112980:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892671.112983:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.112988:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892671.113011:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.113012:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055524480:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (466us total) trans 0 rc 0/0 10000000:01000000:2.0:1789892671.113026:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892671.113032:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:0.0:1789892671.113034:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789892671.113043:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055525120:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892671.113060:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.113063:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055524608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892671.113068:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789892671.113076:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892671.113082:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.113088:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af587 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af58e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.113095:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525248 00000100:00100000:1.0:1789892671.113101:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525248 00010000:00010000:2.0:1789892671.113102:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892671.113107:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892671.113112:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892671.113113:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892671.113116:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525120 00010000:00010000:1.0:1789892671.113120:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 22 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.113121:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525120 00010000:00010000:0.0:1789892671.113142:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 23 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.113143:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055524608 00000100:00100000:3.0:1789892671.113148:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055525376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892671.113149:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055524608 00010000:00010000:1.0:1789892671.113169:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 24 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.113174:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789892671.113178:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892671.113191:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3619:x1876835055525248:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892671.113193:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525376 00000100:00100000:1.0:1789892671.113197:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525376 00000100:00100000:3.0:1789892671.113199:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00010000:00010000:0.0:1789892671.113199:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892671.113206:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 25 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.113210:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055523968:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892671.113213:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 25 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.113225:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 25 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.113239:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af5aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5a3 expref: 25 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.113248:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892671.113248:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00010000:00010000:0.0:1789892671.113251:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892671.113258:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3619:x1876835055525120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892671.113264:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055523968 00000100:00100000:2.0:1789892671.113269:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055523968 00010000:00010000:1.0:1789892671.113269:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892671.113278:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 25 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.113286:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 25 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.113291:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 25 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.113309:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00010000:00010000:1.0:1789892671.113310:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af5b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5b1 expref: 25 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892671.113318:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055524864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892671.113320:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055524608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892671.113325:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892671.113334:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892671.113335:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3619:x1876835055525248:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (365us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892671.113342:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 24 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.113347:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:3.0:1789892671.113357:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892671.113359:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 24 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.113366:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3619:x1876835055525120:12345-0@lo:103:ldlm_bl.0 Request processed in 107us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892671.113372:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055524864 00000100:00100000:3.0:1789892671.113376:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055525504:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892671.113378:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af5d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5cd expref: 23 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892671.113378:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055524864 00000100:00100000:1.0:1789892671.113379:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00010000:00010000:2.0:1789892671.113392:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892671.113401:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 22 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.113408:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00000100:00100000:3.0:1789892671.113419:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892671.113422:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055525376:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892671.113426:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525504 00000100:00100000:0.0:1789892671.113430:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525504 00010000:00010000:1.0:1789892671.113431:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892671.113437:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055524608:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (326us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892671.113443:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 23 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.113445:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 23 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.113448:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00000100:00100000:3.0:1789892671.113452:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055524608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892671.113474:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 22 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.113480:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:0.0:1789892671.113489:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:2.0:1789892671.113494:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055523968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892671.113496:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af59c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af595 expref: 22 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.113503:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892671.113504:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055524864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892671.113513:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 22 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.113517:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892671.113525:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 22 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.113537:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 22 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.113554:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 21 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.113560:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892671.113566:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892671.113574:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99a00/0xd5b980e0d62af5fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5f7 expref: 21 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.113579:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98600/0xd5b980e0d62af5c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af5bf expref: 21 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.113587:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892671.113592:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892671.113596:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:1.0:1789892671.113606:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055525376:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892671.113608:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030857b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055525504:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892671.113615:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00010000:00010000:3.0:1789892671.113619:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892671.113625:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 19 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.113633:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3620:x1876835055523968:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892671.113639:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3620:x1876835055524864:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (283us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892671.113643:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 18 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.113648:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1789892671.113654:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055524480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892671.113658:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:3.0:1789892671.113666:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892671.113674:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055524096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892671.113735:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055525120:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892671.113738:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055523968:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892671.113741:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030857b0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3620:x1876835055525504:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (319us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892671.113748:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892671.113754:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:0.0:1789892671.113760:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055525248:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892671.113764:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055524864:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892671.113777:0:217070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99400/0xd5b980e0d62af58e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af587 expref: 15 pid: 190663 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.113785:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055525504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892671.113792:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a285b100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524352:0@lo:104: 00000100:00100000:2.0:1789892671.113797:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055525376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892671.114127:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524736:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892671.114133:0:217070:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217070:1876835055524992:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892671.114164:0:217070:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.114319:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892671.114347:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892671.114362:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742656 00000100:00100000:1.0:1789892671.114368:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742656 00000100:00100000:3.0:1789892671.114380:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742528 00000100:00100000:3.0:1789892671.114384:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742528 00010000:00010000:1.0:1789892671.114387:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 10 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892671.114395:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 11 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.114412:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 530 00000100:00100000:1.0:1789892671.114421:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062742656:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789892671.114428:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 531 00010000:00010000:1.0:1789892671.114430:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892671.114439:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062742528:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789892671.114439:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 11 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114452:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892671.114461:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 11 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.114461:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 11 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114488:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 11 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.114503:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af580 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603de expref: 11 pid: 194990 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114505:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99600/0xd5b980e0d62af579 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603d7 expref: 11 pid: 190664 timeout: 3461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114524:0:193695:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114536:0:193695:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892671.114546:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892671.114550:0:193695:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114560:0:193695:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114567:0:193695:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114572:0:193695:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892671.114580:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062742656:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 159us (258us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892671.114597:0:193695:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc0d27250) 00000100:00100000:1.0:1789892671.114602:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 530 00010000:00010000:2.0:1789892671.114604:0:193695:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114611:0:193695:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114628:0:193695:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892671.114637:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892671.114653:0:217070:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892671.114661:0:217070:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.114665:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062742528:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 229us (315us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892671.114671:0:217070:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af605 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217070 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892671.114695:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 531 00000100:00100000:1.0:1789892671.505985:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055525632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789892671.506094:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892671.506148:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525632 00000100:00100000:0.0:1789892671.506160:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525632 00000100:00100000:0.0:1789892671.506222:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1789892671.506233:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055525632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789892671.506276:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789892671.506335:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055525632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892671.506361:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1789892671.506375:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055525632:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1789892671.569906:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892672.017901:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055525888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892672.017931:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055525760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892672.017967:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055526016:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789892672.018017:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.018034:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055526144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892672.018080:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.018090:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055526272:0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.018101:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.018144:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.018145:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055526528:0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.018148:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526016 00000100:00100000:0.0:1789892672.018154:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055526656:0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.018161:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526016 00000100:00100000:2.0:1789892672.018194:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.018199:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055526784:0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.018227:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525888 00000100:00100000:0.0:1789892672.018234:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525888 00000100:00100000:2.0:1789892672.018238:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055527040:0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.018251:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789892672.018259:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892672.018273:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055526016:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892672.018287:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.018296:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055527296:0@lo:400:kworker.0 00000004:00000024:1.0:1789892672.018331:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445814272 avail 1299574784 00000100:00100000:0.0:1789892672.018332:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526144 00000100:00100000:0.0:1789892672.018339:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526144 00000100:00100000:2.0:1789892672.018344:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055527552:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.018352:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.018380:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789892672.018396:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055525888:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892672.018410:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.018425:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876835055527808:0@lo:400:kworker.0 00002000:00000024:0.0:1789892672.018432:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892672.018447:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055526016:12345-0@lo:41:osp-pre-0-1.0 Request processed in 180us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.018458:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1789892672.018481:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.018489:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055526016:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892672.018517:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789892672.018521:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055525888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 126us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.018535:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789892672.018537:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789892672.018542:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055526144:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892672.018558:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055525888:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892672.018560:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055526400:0@lo:400:kworker.0 00002000:00000024:1.0:1789892672.018573:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892672.018584:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526272 00000100:00100000:3.0:1789892672.018587:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789892672.018592:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526272 00000100:00100000:3.0:1789892672.018600:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055527168:0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.018643:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055526144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.018659:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2227 00000100:00100000:2.0:1789892672.018660:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.018670:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892672.018670:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789892672.018719:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055526272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.018748:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526400 00000100:00100000:3.0:1789892672.018753:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876835055527680:0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.018755:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526400 00000100:00100000:2.0:1789892672.018760:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055526912:0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.018789:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055526272:12345-0@lo:400:kworker.0 Request processed in 108us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.018798:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1789892672.018803:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2227 00000100:00100000:1.0:1789892672.018819:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055526400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.018829:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.018830:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789892672.018865:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789892672.018866:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055527424:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.018876:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055526272:0@lo:400:kworker.0 00000100:00080000:0.0:1789892672.018877:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789892672.018909:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055526400:12345-0@lo:400:kworker.0 Request processed in 98us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.018917:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526912 00000100:00100000:2.0:1789892672.018925:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.018926:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526912 00000100:00100000:1.0:1789892672.018929:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1789892672.018947:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526784 00000100:00100000:3.0:1789892672.018953:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526784 00000100:00100000:2.0:1789892672.019000:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055526400:0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.019006:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789892672.019019:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527296 00000100:00100000:3.0:1789892672.019027:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527552 00000100:00100000:1.0:1789892672.019027:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527296 00000100:00100000:0.0:1789892672.019029:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055526912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019035:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527552 00000100:00100000:2.0:1789892672.019064:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527808 00000100:00100000:1.0:1789892672.019068:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527680 00000100:00100000:2.0:1789892672.019071:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527808 00000100:00100000:1.0:1789892672.019073:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527680 00000100:00100000:3.0:1789892672.019080:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527424 00000100:00100000:3.0:1789892672.019093:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527424 00000100:00100000:0.0:1789892672.019108:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055526912:12345-0@lo:400:kworker.0 Request processed in 86us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.019123:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:0.0:1789892672.019124:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789892672.019154:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055526784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892672.019155:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1789892672.019174:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789892672.019182:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876835055527296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.019192:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789892672.019196:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055527552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019212:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+11:3619:x1876835055526784:12345-0@lo:400:kworker.0 Request processed in 76us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.019218:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876835055527680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019224:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1789892672.019252:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00000100:00100000:1.0:1789892672.019264:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876835055527808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019271:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0001-lwp-OST0000_UUID+5:3621:x1876835055527552:12345-0@lo:400:kworker.0 Request processed in 80us (861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.019281:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3619:x1876835055527296:12345-0@lo:400:kworker.0 Request processed in 106us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.019282:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:0.0:1789892672.019300:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876835055527680:12345-0@lo:400:kworker.0 Request processed in 91us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.019301:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00000100:00100000:3.0:1789892672.019317:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789892672.019326:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3619:x1876835055527808:12345-0@lo:400:kworker.0 Request processed in 64us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.019333:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00000100:00100000:3.0:1789892672.019335:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055527424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019344:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1789892672.019385:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055526912:0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.019393:0:192178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526528 00000100:00100000:1.0:1789892672.019394:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527040 00000100:00100000:1.0:1789892672.019402:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527040 00000100:00100000:0.0:1789892672.019403:0:192178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526528 00000100:00100000:3.0:1789892672.019414:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055527424:12345-0@lo:400:kworker.0 Request processed in 84us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.019418:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055527424:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019435:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00000100:00100000:1.0:1789892672.019452:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527168 00000100:00100000:1.0:1789892672.019460:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527168 00010000:00080000:2.0:1789892672.019471:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90309210c700 x1876835055527552/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892672.019476:0:192178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789892672.019498:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3621:1876835055527552:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019499:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789892672.019510:0:192178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055527040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019514:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789892672.019521:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055526528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019532:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055527168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019601:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055527168:12345-0@lo:400:kworker.0 Request processed in 73us (950us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.019611:0:192178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055527040:12345-0@lo:400:kworker.0 Request processed in 110us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.019612:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055526528:12345-0@lo:400:kworker.0 Request processed in 94us (1416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.019616:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789892672.019624:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055526528:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019636:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789892672.019651:0:192178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789892672.019660:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.019671:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055527040:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019705:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055526656 00000100:00100000:3.0:1789892672.019711:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055526656 00000100:00100000:1.0:1789892672.019759:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055526144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892672.019763:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1789892672.019764:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789892672.019780:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892672.019790:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055526656:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789892672.019793:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789892672.019807:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892672.019828:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.019837:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055526656:12345-0@lo:400:kworker.0 Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.019843:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789892672.019873:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055527168:0@lo:400:kworker.0 00000100:00100000:1.0:1789892672.019889:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055526656:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.019905:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055525760 00000100:00100000:3.0:1789892672.019910:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055525760 00000100:00100000:0.0:1789892672.019916:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876835055527680:0@lo:400:kworker.0 00010000:00080000:0.0:1789892672.019945:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90309210f480 x1876835055527808/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892688 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892672.019950:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789892672.019962:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055525760:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892672.019965:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3619:1876835055527808:0@lo:400:kworker.0 00000100:00100000:0.0:1789892672.019980:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3619:1876835055526784:0@lo:400:kworker.0 00002000:00000024:3.0:1789892672.019981:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892672.020021:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3619:1876835055527296:0@lo:400:kworker.0 00000100:00100000:3.0:1789892672.020047:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055525760:12345-0@lo:13:osp-pre-1-1.0 Request processed in 87us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.020055:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1789892672.020107:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055525760:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892672.315874:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892672.316005:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742784 00000100:00100000:1.0:1789892672.316038:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742784 00000100:00100000:1.0:1789892672.316105:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2228 00000100:00100000:1.0:1789892672.316115:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062742784:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892672.316134:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892672.316155:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603e5 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.316186:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.316197:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.316206:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892672.316281:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062742784:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 168us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.316286:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2228 00000100:00100000:1.0:1789892672.317404:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892672.317464:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062742912 00000100:00100000:0.0:1789892672.317472:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062742912 00000100:00100000:0.0:1789892672.317518:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2229 00000100:00100000:0.0:1789892672.317530:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062742912:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.317742:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062742912:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 213us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.317767:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2229 00000100:00100000:3.0:1789892672.318553:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892672.318627:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743040 00000100:00100000:0.0:1789892672.318632:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743040 00000100:00100000:0.0:1789892672.318662:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2230 00000100:00100000:0.0:1789892672.318667:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062743040:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.318826:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062743040:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 158us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.318832:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2230 00000100:00100000:2.0:1789892672.319842:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892672.319928:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743168 00000100:00100000:3.0:1789892672.319941:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743168 00000100:00100000:3.0:1789892672.320110:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2231 00000100:00100000:3.0:1789892672.320119:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216139:x1876835062743168:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892672.320238:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216139:x1876835062743168:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 120us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.320246:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2231 00000100:00100000:1.0:1789892672.321038:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892672.321081:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743296 00000100:00100000:3.0:1789892672.321085:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743296 00000100:00100000:3.0:1789892672.321107:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2232 00000100:00100000:3.0:1789892672.321112:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216139:x1876835062743296:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892672.321187:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216139:x1876835062743296:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 72us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.321197:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2232 00000100:00100000:2.0:1789892672.322141:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892672.322202:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743424 00000100:00100000:0.0:1789892672.322211:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743424 00000100:00100000:0.0:1789892672.322260:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2233 00000100:00100000:0.0:1789892672.322269:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062743424:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892672.322284:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892672.322299:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603ec expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.322322:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.322331:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.322347:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98600, rc 0) 00000100:00100000:0.0:1789892672.322392:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062743424:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 125us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.322398:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2233 00000100:00100000:2.0:1789892672.323107:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892672.323152:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743552 00000100:00100000:0.0:1789892672.323157:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743552 00000100:00100000:0.0:1789892672.323187:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2234 00000100:00100000:0.0:1789892672.323194:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062743552:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.323274:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062743552:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 81us (168us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892672.323280:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2234 00010000:00010000:3.0:1789892672.593922:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892672.913807:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892672.913815:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 174 10000000:01000000:2.0:1789892672.913821:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892672.913876:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.913888:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.913899:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.913925:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055527936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.914017:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.914071:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892672.914263:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055527936 00000100:00100000:3.0:1789892672.914273:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055527936 00000100:00100000:3.0:1789892672.914330:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2235 00000100:00100000:3.0:1789892672.914339:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055527936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892672.914353:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892672.914381:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af61a expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.914409:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.914421:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.914430:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c400, rc 0) 00000100:00100000:3.0:1789892672.914478:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055527936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.914485:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2235 00000100:00100000:2.0:1789892672.914527:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055527936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892672.914545:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.914554:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.914624:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.914651:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.914670:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc220c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892672.914708:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528064 00000100:00100000:3.0:1789892672.914714:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528064 00000100:00100000:3.0:1789892672.914744:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2236 00000100:00100000:3.0:1789892672.914750:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055528064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.914869:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055528064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 118us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.914876:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2236 00000100:00100000:2.0:1789892672.914910:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.914942:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.915001:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.915026:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc220c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.915101:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528192 00000100:00100000:0.0:1789892672.915108:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528192 00000100:00100000:0.0:1789892672.915149:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2237 00000100:00100000:0.0:1789892672.915158:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055528192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.915262:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055528192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.915269:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2237 00000100:00100000:2.0:1789892672.915307:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.915719:0:217074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217074:1876835055528320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.915754:0:217074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.915777:0:217074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.915839:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528320 00000100:00100000:0.0:1789892672.915847:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528320 00000100:00100000:0.0:1789892672.915882:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2238 00000100:00100000:0.0:1789892672.915889:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217074:x1876835055528320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.916015:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217074:x1876835055528320:12345-0@lo:502:llog_process_th.0 Request processed in 125us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.916033:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2238 00000100:00100000:2.0:1789892672.916068:0:217074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217074:1876835055528320:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.916125:0:217074:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217074:1876835055528448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.916175:0:217074:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.916202:0:217074:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892672.916270:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528448 00000100:00100000:3.0:1789892672.916279:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528448 00000100:00100000:3.0:1789892672.916324:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2239 00000100:00100000:3.0:1789892672.916338:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217074:x1876835055528448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.916444:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217074:x1876835055528448:12345-0@lo:502:llog_process_th.0 Request processed in 111us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.916451:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2239 00000100:00100000:2.0:1789892672.916503:0:217074:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217074:1876835055528448:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892672.916536:0:217074:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:3.0:1789892672.916638:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:3.0:1789892672.916669:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892672.916699:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.916710:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892672.916719:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892672.916721:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892672.916723:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892672.916742:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.916749:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.916757:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.916771:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.916803:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.916831:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.916884:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528576 00000100:00100000:1.0:1789892672.916899:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528576 00000100:00100000:1.0:1789892672.916957:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2240 00000100:00100000:1.0:1789892672.916974:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055528576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892672.917005:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892672.917037:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af628 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.917067:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.917080:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.917089:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7200, rc 0) 00000100:00100000:1.0:1789892672.917167:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055528576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 200us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.917179:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2240 00000100:00100000:3.0:1789892672.917216:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892672.917231:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.917240:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.917288:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.917343:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.917367:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.917421:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528704 00000100:00100000:0.0:1789892672.917431:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528704 00000100:00100000:0.0:1789892672.917476:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2241 00000100:00100000:0.0:1789892672.917486:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055528704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.917579:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055528704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 94us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.917589:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2241 00000100:00100000:3.0:1789892672.917607:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.917637:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.917674:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.917731:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528832 00000100:00100000:0.0:1789892672.917737:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528832 00000100:00100000:3.0:1789892672.917744:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.917782:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2242 00000100:00100000:0.0:1789892672.917790:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055528832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.917872:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055528832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.917881:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2242 00000100:00100000:3.0:1789892672.917909:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892672.918731:0:217075:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:2.0:1789892672.918814:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892672.918838:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892672.918846:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.918875:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892672.918886:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892672.918889:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 174 10000000:01000000:2.0:1789892672.918892:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892672.918915:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.918926:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.918937:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.918957:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.919033:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.919079:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc229c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892672.919080:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055528960 00000100:00100000:3.0:1789892672.919089:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055528960 00000100:00100000:3.0:1789892672.919123:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2243 00000100:00100000:3.0:1789892672.919130:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055528960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892672.919139:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892672.919149:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af636 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.919166:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.919174:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.919181:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d800, rc 0) 00000100:00100000:3.0:1789892672.919218:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055528960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.919224:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2243 00000100:00100000:2.0:1789892672.919288:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055528960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892672.919308:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.919322:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.919387:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.919430:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.919474:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc229c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.919504:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529088 00000100:00100000:1.0:1789892672.919513:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529088 00000100:00100000:1.0:1789892672.919550:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2244 00000100:00100000:1.0:1789892672.919557:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055529088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892672.919732:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055529088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 174us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.919742:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2244 00000100:00100000:2.0:1789892672.919778:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.919826:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.919882:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.919918:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc229c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.920007:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529216 00000100:00100000:0.0:1789892672.920015:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529216 00000100:00100000:0.0:1789892672.920056:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2245 00000100:00100000:0.0:1789892672.920065:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055529216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.920163:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055529216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.920172:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2245 00000100:00100000:3.0:1789892672.920190:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.920468:0:217076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217076:1876835055529344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.920508:0:217076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.920527:0:217076:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308b1a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.920547:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529344 00000100:00100000:0.0:1789892672.920553:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529344 00000100:00100000:0.0:1789892672.920585:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2246 00000100:00100000:0.0:1789892672.920591:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217076:x1876835055529344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.920714:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217076:x1876835055529344:12345-0@lo:502:llog_process_th.0 Request processed in 119us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.920724:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2246 00000100:00100000:3.0:1789892672.920747:0:217076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217076:1876835055529344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.920823:0:217076:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217076:1876835055529472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.920877:0:217076:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.920925:0:217076:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.920928:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529472 00000100:00100000:0.0:1789892672.920935:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529472 00000100:00100000:0.0:1789892672.920997:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2247 00000100:00100000:0.0:1789892672.921004:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217076:x1876835055529472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.921082:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217076:x1876835055529472:12345-0@lo:502:llog_process_th.0 Request processed in 78us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.921089:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2247 00000100:00100000:3.0:1789892672.921127:0:217076:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217076:1876835055529472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892672.921157:0:217076:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:2.0:1789892672.921233:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:2.0:1789892672.921262:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892672.921270:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.921283:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892672.921311:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892672.921314:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892672.921317:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892672.921343:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.921354:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.921367:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.921388:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.921431:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.921462:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc22c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.921496:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529600 00000100:00100000:1.0:1789892672.921504:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529600 00000100:00100000:1.0:1789892672.921540:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2248 00000100:00100000:1.0:1789892672.921547:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055529600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892672.921558:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892672.921572:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af644 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.921590:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.921610:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.921618:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6400, rc 0) 00000100:00100000:1.0:1789892672.921665:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055529600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.921672:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2248 00000100:00100000:2.0:1789892672.921771:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892672.921808:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.921823:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.921889:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.921938:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.922019:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529728 00000100:00100000:2.0:1789892672.922026:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.922027:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529728 00000100:00100000:0.0:1789892672.922065:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2249 00000100:00100000:0.0:1789892672.922073:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055529728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.922157:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055529728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.922165:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2249 00000100:00100000:2.0:1789892672.922197:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.922235:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.922291:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.922318:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031bfc22c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.922339:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529856 00000100:00100000:0.0:1789892672.922345:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529856 00000100:00100000:0.0:1789892672.922372:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2250 00000100:00100000:0.0:1789892672.922377:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055529856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.922458:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055529856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.922467:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2250 00000100:00100000:2.0:1789892672.922493:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529856:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892672.923641:0:217077:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789892672.923728:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789892672.923750:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892672.923759:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.923769:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892672.923777:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892672.923779:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 174 10000000:01000000:3.0:1789892672.923782:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892672.923799:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.923806:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.923826:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.923839:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.923867:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.923894:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308b1a2840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.923968:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055529984 00000100:00100000:0.0:1789892672.923976:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055529984 00000100:00100000:0.0:1789892672.924037:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2251 00000100:00100000:0.0:1789892672.924045:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055529984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892672.924054:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892672.924066:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af652 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.924084:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.924094:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.924101:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98000, rc 0) 00000100:00100000:0.0:1789892672.924147:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055529984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (278us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.924155:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2251 00000100:00100000:3.0:1789892672.924181:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055529984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892672.924195:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.924204:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.924242:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.924267:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.924286:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308b1a2840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.924326:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530112 00000100:00100000:1.0:1789892672.924335:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530112 00000100:00100000:1.0:1789892672.924371:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2252 00000100:00100000:1.0:1789892672.924382:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055530112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892672.924490:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055530112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.924501:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2252 00000100:00100000:3.0:1789892672.924531:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.924561:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.924605:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.924625:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308b1a2840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892672.924666:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530240 00000100:00100000:2.0:1789892672.924706:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530240 00000100:00100000:2.0:1789892672.924764:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2253 00000100:00100000:2.0:1789892672.924780:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055530240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.924911:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055530240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 134us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.924926:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2253 00000100:00100000:3.0:1789892672.924936:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.925251:0:217078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217078:1876835055530368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.925322:0:217078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.925369:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530368 00000100:00100000:2.0:1789892672.925374:0:217078:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.925375:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530368 00000100:00100000:0.0:1789892672.925416:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2254 00000100:00100000:0.0:1789892672.925423:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217078:x1876835055530368:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.925522:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217078:x1876835055530368:12345-0@lo:502:llog_process_th.0 Request processed in 97us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.925530:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2254 00000100:00100000:2.0:1789892672.925577:0:217078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217078:1876835055530368:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.925640:0:217078:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217078:1876835055530496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.925740:0:217078:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.925781:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530496 00000100:00100000:2.0:1789892672.925786:0:217078:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.925787:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530496 00000100:00100000:0.0:1789892672.925823:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2255 00000100:00100000:0.0:1789892672.925832:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217078:x1876835055530496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.925913:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217078:x1876835055530496:12345-0@lo:502:llog_process_th.0 Request processed in 80us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.925929:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2255 00000100:00100000:2.0:1789892672.925940:0:217078:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217078:1876835055530496:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892672.926013:0:217078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:3.0:1789892672.926083:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:3.0:1789892672.926108:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892672.926114:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.926131:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892672.926138:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892672.926140:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 200 10000000:01000000:3.0:1789892672.926142:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892672.926157:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.926164:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.926171:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.926183:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.926211:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.926231:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.926270:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530624 00000100:00100000:1.0:1789892672.926278:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530624 00000100:00100000:1.0:1789892672.926327:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2256 00000100:00100000:1.0:1789892672.926335:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055530624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892672.926345:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892672.926356:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af660 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.926374:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.926385:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892672.926408:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6e00, rc 0) 00000100:00100000:1.0:1789892672.926456:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055530624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.926462:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2256 00000100:00100000:3.0:1789892672.926497:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892672.926514:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.926523:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.926563:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.926594:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.926625:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892672.926659:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530752 00000100:00100000:2.0:1789892672.926669:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530752 00000100:00100000:2.0:1789892672.926791:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2257 00000100:00100000:2.0:1789892672.926806:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055530752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.926927:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055530752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 124us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.926940:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2257 00000100:00100000:3.0:1789892672.926972:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.927021:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.927068:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.927098:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.927114:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055530880 00000100:00100000:0.0:1789892672.927122:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055530880 00000100:00100000:0.0:1789892672.927162:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2258 00000100:00100000:0.0:1789892672.927171:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055530880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.927305:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055530880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.927318:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2258 00000100:00100000:3.0:1789892672.927324:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055530880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.927625:0:217079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217079:1876835055531008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.927663:0:217079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.927723:0:217079:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.927765:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531008 00000100:00100000:0.0:1789892672.927774:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531008 00000100:00100000:0.0:1789892672.927813:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2259 00000100:00100000:0.0:1789892672.927824:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217079:x1876835055531008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.927958:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217079:x1876835055531008:12345-0@lo:502:llog_process_th.0 Request processed in 120us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.927969:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2259 00000100:00100000:3.0:1789892672.928004:0:217079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217079:1876835055531008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892672.928036:0:217079:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892672.928047:0:217079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892672.928050:0:217079:0:(obd_config.c:1561:class_process_config()) marker 188 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:3.0:1789892672.928055:0:217079:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892672.928072:0:217079:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000100:00100000:3.0:1789892672.928089:0:217079:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217079:1876835055531136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.928125:0:217079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.928144:0:217079:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.928181:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531136 00000100:00100000:1.0:1789892672.928189:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531136 00000100:00100000:1.0:1789892672.928227:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2260 00000100:00100000:1.0:1789892672.928236:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217079:x1876835055531136:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892672.928363:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217079:x1876835055531136:12345-0@lo:502:llog_process_th.0 Request processed in 122us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.928372:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2260 00000100:00100000:3.0:1789892672.928378:0:217079:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217079:1876835055531136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892672.928418:0:217079:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892672.928423:0:217079:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892672.928425:0:217079:0:(obd_config.c:1561:class_process_config()) marker 188 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:3.0:1789892672.928429:0:217079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 203 count 199 00000020:01000000:2.0:1789892672.928497:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 200-202 (rc=0) 10000000:01000000:2.0:1789892672.928524:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892672.928531:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.928541:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892672.928550:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892672.928551:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 174 10000000:01000000:2.0:1789892672.928554:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892672.928589:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.928609:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.928617:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.928631:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.928682:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.928733:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.928780:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531264 00000100:00100000:0.0:1789892672.928788:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531264 00000100:00100000:0.0:1789892672.928827:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2261 00000100:00100000:0.0:1789892672.928837:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055531264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892672.928848:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892672.928858:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af66e expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.928876:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.928885:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.928902:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892672.928950:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055531264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.928958:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2261 00000100:00100000:2.0:1789892672.928995:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892672.929013:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.929022:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.929061:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.929088:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.929105:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.929128:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531392 00000100:00100000:0.0:1789892672.929133:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531392 00000100:00100000:0.0:1789892672.929165:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2262 00000100:00100000:0.0:1789892672.929171:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055531392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.929273:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055531392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.929286:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2262 00000100:00100000:2.0:1789892672.929307:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.929341:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.929378:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.929397:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892672.929418:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531520 00000100:00100000:3.0:1789892672.929424:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531520 00000100:00100000:3.0:1789892672.929457:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2263 00000100:00100000:3.0:1789892672.929471:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055531520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.929554:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055531520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892672.929564:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2263 00000100:00100000:2.0:1789892672.929578:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.929893:0:217080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217080:1876835055531648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.929935:0:217080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.929963:0:217080:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.929993:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531648 00000100:00100000:1.0:1789892672.929999:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531648 00000100:00100000:1.0:1789892672.930028:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2264 00000100:00100000:1.0:1789892672.930033:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217080:x1876835055531648:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892672.930134:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217080:x1876835055531648:12345-0@lo:502:llog_process_th.0 Request processed in 98us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.930141:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2264 00000100:00100000:2.0:1789892672.930176:0:217080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217080:1876835055531648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.930236:0:217080:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217080:1876835055531776:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.930311:0:217080:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.930339:0:217080:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.930372:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531776 00000100:00100000:0.0:1789892672.930379:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531776 00000100:00100000:0.0:1789892672.930431:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2265 00000100:00100000:0.0:1789892672.930438:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217080:x1876835055531776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892672.930555:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217080:x1876835055531776:12345-0@lo:502:llog_process_th.0 Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.930568:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2265 00000100:00100000:2.0:1789892672.930581:0:217080:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217080:1876835055531776:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892672.930621:0:217080:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000020:01000000:3.0:1789892672.930722:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 174-176 (rc=0) 10000000:01000000:3.0:1789892672.930747:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892672.930756:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.930766:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892672.930775:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789892672.930777:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 200 10000000:01000000:3.0:1789892672.930780:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892672.930797:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.930805:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.930813:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.930825:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.930854:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.930882:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.930905:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055531904 00000100:00100000:0.0:1789892672.930912:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055531904 00000100:00100000:0.0:1789892672.930960:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2266 00000100:00100000:0.0:1789892672.930966:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055531904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892672.930973:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892672.931005:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af67c expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.931034:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.931043:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.931050:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98200, rc 0) 00000100:00100000:0.0:1789892672.931091:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055531904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.931098:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2266 00000100:00100000:3.0:1789892672.931124:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055531904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892672.931147:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892672.931156:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892672.931192:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.931220:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.931240:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.931293:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532032 00000100:00100000:0.0:1789892672.931302:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532032 00000100:00100000:0.0:1789892672.931335:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2267 00000100:00100000:0.0:1789892672.931341:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055532032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892672.931425:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055532032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.931432:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2267 00000100:00100000:3.0:1789892672.931461:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.931493:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.931532:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.931552:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.931613:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532160 00000100:00100000:1.0:1789892672.931622:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532160 00000100:00100000:1.0:1789892672.931655:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2268 00000100:00100000:1.0:1789892672.931661:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055532160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892672.931820:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055532160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 157us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892672.931828:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2268 00000100:00100000:3.0:1789892672.931837:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892672.932119:0:217081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217081:1876835055532288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892672.932160:0:217081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892672.932185:0:217081:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bd900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892672.932213:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532288 00000100:00100000:2.0:1789892672.932223:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532288 00000100:00100000:2.0:1789892672.932270:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2269 00000100:00100000:2.0:1789892672.932285:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217081:x1876835055532288:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.932438:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217081:x1876835055532288:12345-0@lo:502:llog_process_th.0 Request processed in 155us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.932452:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2269 00000100:00100000:3.0:1789892672.932463:0:217081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217081:1876835055532288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892672.932494:0:217081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892672.932502:0:217081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892672.932504:0:217081:0:(obd_config.c:1561:class_process_config()) marker 187 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000020:00000080:3.0:1789892672.932509:0:217081:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892672.932517:0:217081:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0000_UUID removed from qpool1 00000020:01000004:0.0:1789892672.933033:0:217082:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1789892672.933039:0:217082:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:1.0:1789892672.933051:0:217081:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217081:1876835055532416:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892672.933105:0:217081:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892672.933168:0:217081:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892672.933176:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532416 00000100:00100000:2.0:1789892672.933186:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532416 00000100:00100000:2.0:1789892672.933253:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2270 00000100:00100000:2.0:1789892672.933271:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217081:x1876835055532416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892672.933422:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217081:x1876835055532416:12345-0@lo:502:llog_process_th.0 Request processed in 141us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892672.933435:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2270 00000100:00100000:1.0:1789892672.933470:0:217081:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217081:1876835055532416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892672.933503:0:217081:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892672.933510:0:217081:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892672.933512:0:217081:0:(obd_config.c:1561:class_process_config()) marker 187 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0000_UUID 00000040:00080000:1.0:1789892672.933515:0:217081:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 203 count 199 00000020:01000000:2.0:1789892672.933607:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 200-202 (rc=0) 10000000:01000000:2.0:1789892672.933640:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892672.933649:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.933674:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892672.933724:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892672.933728:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:2.0:1789892672.933732:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892672.933760:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.933772:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.933784:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.933809:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.933853:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892672.933902:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532544 00000100:00100000:2.0:1789892672.933907:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030821829c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892672.933910:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532544 00000100:00100000:0.0:1789892672.933967:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2271 00000100:00100000:0.0:1789892672.933995:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055532544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892672.934005:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892672.934015:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af68a expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.934048:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.934057:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892672.934064:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99800, rc 0) 00000100:00100000:0.0:1789892672.934107:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055532544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892672.934114:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2271 00000100:00100000:2.0:1789892672.934150:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892672.934171:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.934183:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892672.934243:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892672.934282:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892672.934324:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030821829c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892672.934331:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532672 00000100:00100000:1.0:1789892672.934339:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532672 00000100:00100000:1.0:1789892672.934369:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2272 00000100:00100000:1.0:1789892672.934377:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055532672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892672.934440:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055532672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (159us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892672.934457:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2272 00000100:00100000:2.0:1789892672.934497:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055532672:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892672.934536:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892672.934545:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892672.934557:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:2.0:1789892673.404417:0:217130:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffcd33865e0 20000000:00000080:2.0:1789892673.404434:0:217130:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff903093cd0000 uarg=0000000000000000 00000040:00100000:2.0:1789892673.405150:0:217130:0:(llog.c:1072:llog_reverse_process()) index 176 : idx 137 20000000:01000000:2.0:1789892673.405159:0:217130:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 166 cmd:0xce021 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:2.0:1789892673.405172:0:217130:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892673.405444:0:217131:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 165 marker 177 1->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892673.405487:0:217131:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 167 marker 177 2->4: lustre-clilov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892673.405503:0:217131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 177 count 174 00000040:00080000:1.0:1789892673.405654:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].177, 224 off40584 20000000:01000000:1.0:1789892673.405671:0:217130:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892673.405720:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].178, 128 off40712 00000040:00080000:1.0:1789892673.405739:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].179, 224 off40936 20000000:01000000:1.0:1789892673.405753:0:217130:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892673.406057:0:217132:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 191 marker 178 1->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892673.406075:0:217132:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 193 marker 178 2->4: lustre-MDT0000-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892673.406085:0:217132:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 203 count 199 00000040:00080000:1.0:1789892673.406178:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].203, 224 off45400 20000000:01000000:1.0:1789892673.406189:0:217130:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892673.406200:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].204, 136 off45536 00000040:00080000:1.0:1789892673.406211:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].205, 224 off45760 20000000:01000000:1.0:1789892673.406218:0:217130:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool1.lustre-OST0001_UUID fl=4 20000000:01000000:2.0:1789892673.406422:0:217133:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 191 marker 179 1->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 20000000:01000000:2.0:1789892673.406437:0:217133:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 193 marker 179 2->4: lustre-MDT0001-mdtlov add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892673.406447:0:217133:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 203 count 199 00000040:00080000:1.0:1789892673.406516:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].203, 224 off45400 20000000:01000000:1.0:1789892673.406524:0:217130:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892673.406532:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].204, 136 off45536 00000040:00080000:1.0:1789892673.406552:0:217130:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].205, 224 off45760 10000000:01000000:1.0:1789892673.406559:0:217130:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892673.406576:0:217130:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406592:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406598:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406603:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406607:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406612:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406616:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406620:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406624:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406628:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406640:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406645:0:217130:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406649:0:217130:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406701:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.406713:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 23 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.406724:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055532800:0@lo:104: 00000100:00100000:1.0:1789892673.406775:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892673.406815:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.406823:0:190653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892673.406823:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 23 pid: 190664 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.406835:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055532928:0@lo:104: 00000100:00100000:3.0:1789892673.406841:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532800 00000100:00100000:3.0:1789892673.406859:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532800 00000100:00100000:1.0:1789892673.406865:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892673.406903:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055532928 00010000:00010000:1.0:1789892673.406904:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.406909:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 482 00000100:00100000:2.0:1789892673.406909:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055532928 00010000:00010000:1.0:1789892673.406921:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 23 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.406924:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903093cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055532800:12345-0@lo:104: 00010000:00010000:3.0:1789892673.406939:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.406941:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533056:0@lo:104: 00000100:00100000:2.0:1789892673.406950:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 483 00000100:00100000:2.0:1789892673.406964:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055532928:12345-0@lo:104: 00010000:00010000:2.0:1789892673.406993:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.406997:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892673.407016:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892673.407023:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903093cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055532800:12345-0@lo:104: Request processed in 103us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.407031:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 482 00000100:00100000:0.0:1789892673.407033:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533056 00010000:00010000:1.0:1789892673.407035:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.407042:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533056 00010000:00010000:1.0:1789892673.407047:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407050:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892673.407058:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533184:0@lo:104: 00000100:00100000:2.0:1789892673.407059:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055532928:12345-0@lo:104: Request processed in 99us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892673.407071:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 483 00000100:00100000:3.0:1789892673.407078:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 484 00000100:00100000:3.0:1789892673.407090:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217130:x1876835055533056:12345-0@lo:104: 00000100:00100000:1.0:1789892673.407095:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892673.407099:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892673.407101:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407106:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407111:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892673.407116:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892673.407119:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892673.407122:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407126:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407141:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892673.407143:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892673.407149:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892673.407149:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407152:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 23 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407154:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217130:x1876835055533056:12345-0@lo:104: Request processed in 66us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.407175:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 484 10000000:00010000:2.0:1789892673.407180:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407181:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.407185:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533312:0@lo:104: 00000100:00100000:3.0:1789892673.407191:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533184 00000100:00100000:3.0:1789892673.407198:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533184 10000000:01000000:2.0:1789892673.407202:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892673.407205:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892673.407211:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892673.407221:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892673.407234:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533312 00010000:00010000:2.0:1789892673.407235:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407239:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533312 00010000:00010000:2.0:1789892673.407244:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892673.407246:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407251:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407260:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 485 00010000:00010000:2.0:1789892673.407263:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407273:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533184:12345-0@lo:104: 00010000:00010000:1.0:1789892673.407274:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407285:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892673.407289:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383600/0xd5b980e0d62af68a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af691 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.407291:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.407295:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082130a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533696:0@lo:104: 00010000:00010000:0.0:1789892673.407298:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407319:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d600/0xd5b980e0d62af67c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af683 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407325:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892673.407329:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407332:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892673.407335:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382c00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892673.407336:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:2.0:1789892673.407342:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.407342:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892673.407343:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892673.407349:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00010000:00010000:0.0:1789892673.407352:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407354:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407368:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407369:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9dc00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892673.407373:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533184:12345-0@lo:104: Request processed in 100us (279us total) trans 0 rc 0/0 10000000:00010000:2.0:1789892673.407374:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892673.407375:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407394:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 485 10000000:01000000:2.0:1789892673.407399:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892673.407401:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407414:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533696 10000000:00010000:0.0:1789892673.407415:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407416:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 23 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407419:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533696 00010000:00010000:2.0:1789892673.407423:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407438:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 486 10000000:01000000:0.0:1789892673.407438:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892673.407443:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533824:0@lo:104: 00010000:00010000:2.0:1789892673.407447:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892673.407451:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533312:12345-0@lo:104: 00010000:00010000:3.0:1789892673.407460:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407465:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407467:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.407478:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892673.407478:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892673.407486:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382c00/0xd5b980e0d62af66e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af675 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407492:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407501:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892673.407506:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af660 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af667 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407507:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892673.407510:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.407519:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1789892673.407522:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892673.407529:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892673.407533:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892673.407534:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407535:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533312:12345-0@lo:104: Request processed in 82us (310us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892673.407535:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407536:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892673.407547:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533824 00000100:00100000:0.0:1789892673.407552:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533824 00000100:00100000:3.0:1789892673.407558:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 486 00000100:00100000:1.0:1789892673.407560:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b749f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534208:0@lo:104: 00010000:00010000:2.0:1789892673.407564:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892673.407569:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407575:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892673.407582:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.407583:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 487 00000100:00100000:1.0:1789892673.407592:0:217130:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789892673.407594:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892673.407596:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 488 00000100:00100000:0.0:1789892673.407603:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533696:12345-0@lo:104: 00000100:00100000:3.0:1789892673.407610:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533824:12345-0@lo:104: 00010000:00010000:1.0:1789892673.407617:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407618:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.407621:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407621:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407641:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 23 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407647:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892673.407656:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.407658:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b74a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534336:0@lo:104: 00010000:00010000:2.0:1789892673.407670:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af652 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af659 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.407698:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892673.407700:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892673.407701:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892673.407727:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892673.407728:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055533440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892673.407736:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055533824:12345-0@lo:104: Request processed in 128us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.407742:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 488 00010000:00010000:0.0:1789892673.407745:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892673.407753:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217130:x1876835055533696:12345-0@lo:104: Request processed in 156us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892673.407761:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 487 00000100:00100000:3.0:1789892673.407772:0:190653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789892673.407772:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892673.407778:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055534208 00010000:00010000:1.0:1789892673.407779:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.407782:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055534208 00010000:00010000:1.0:1789892673.407792:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 9 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.407800:0:191419:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892673.407801:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055534464:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892673.407809:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 489 00000100:00100000:1.0:1789892673.407815:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b749880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534592:192.168.203.53@tcp:104: 00000100:00100000:3.0:1789892673.407820:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309182b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217130:x1876835055534208:12345-0@lo:104: 00000100:00100000:0.0:1789892673.407824:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055534336 00000100:00100000:0.0:1789892673.407829:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055534336 00000100:00100000:2.0:1789892673.407835:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892673.407836:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.407853:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 490 00000100:00100000:0.0:1789892673.407861:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055534336:12345-0@lo:104: 00010000:00010000:0.0:1789892673.407869:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.407875:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789892673.407880:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789892673.407885:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055533568:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892673.407891:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309182b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217130:x1876835055534208:12345-0@lo:104: Request processed in 72us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.407898:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 489 00010000:00010000:0.0:1789892673.407908:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789892673.407915:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217130:x1876835055534336:12345-0@lo:104: Request processed in 55us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892673.407924:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892673.407933:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 490 00010000:00010000:3.0:1789892673.407938:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789892673.407943:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.407950:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892673.407953:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.407959:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892673.407964:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.407967:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:2.0:1789892673.407969:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055533952:0@lo:103:ldlm_bl.0 10000000:01000000:3.0:1789892673.407988:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892673.407990:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.407999:0:217130:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408003:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892673.408008:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408017:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408017:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892673.408020:0:217130:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 9 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408034:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408039:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892673.408040:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789892673.408047:0:217130:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534720:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892673.408051:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055534080:0@lo:103:ldlm_bl.0 10000000:00010000:0.0:1789892673.408052:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892673.408060:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892673.408080:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408085:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892673.408090:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892673.408090:0:217130:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371c180 going to sleep for 11 seconds 00010000:00010000:0.0:1789892673.408095:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408100:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af644 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af64b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408113:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892673.408114:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055532800:0@lo:104: 00010000:00010000:0.0:1789892673.408118:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408120:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408120:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055534976:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892673.408128:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055532928:0@lo:104: 00010000:00010000:3.0:1789892673.408143:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af636 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af63d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408144:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533056:0@lo:104: 00010000:00010000:0.0:1789892673.408147:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892673.408152:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408156:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533184:0@lo:104: 00000100:00100000:2.0:1789892673.408157:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892673.408173:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408176:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533312:0@lo:104: 00010000:00010000:3.0:1789892673.408180:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892673.408188:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892673.408188:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408195:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082130a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533696:0@lo:104: 00000100:00100000:2.0:1789892673.408197:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533440 00000100:00100000:2.0:1789892673.408203:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533440 10000000:01000000:0.0:1789892673.408210:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892673.408211:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082132a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055533824:0@lo:104: 00010000:00010000:3.0:1789892673.408212:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383c00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892673.408218:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408225:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408228:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b749f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534208:0@lo:104: 00010000:00010000:2.0:1789892673.408229:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 24 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408230:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892673.408234:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408244:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b74a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534336:0@lo:104: 00010000:00010000:0.0:1789892673.408257:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789892673.408258:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892673.408267:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055534464 00000100:00100000:2.0:1789892673.408270:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055534464 00010000:00010000:3.0:1789892673.408280:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.408284:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 25 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408289:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892673.408289:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408300:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408304:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533568 00010000:00010000:0.0:1789892673.408304:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af628 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af62f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408309:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533568 00010000:00010000:3.0:1789892673.408310:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383c00/0xd5b980e0d62af61a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af621 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.408323:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 26 pid: 190664 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408324:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892673.408330:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892673.408330:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892673.408334:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892673.408335:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892673.408341:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892673.408342:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055533952 00000100:00100000:1.0:1789892673.408346:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055534080 00000100:00100000:2.0:1789892673.408347:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055533952 00010000:00010000:3.0:1789892673.408349:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892673.408354:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055534080 00010000:00010000:2.0:1789892673.408363:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 28 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.408364:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055534976 00010000:00010000:3.0:1789892673.408365:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892673.408372:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055534976 00010000:00010000:1.0:1789892673.408375:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 28 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408395:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 29 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408413:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:1.0:1789892673.408425:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789892673.408426:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3620:x1876835055533440:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892673.408436:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00010000:00010000:2.0:1789892673.408438:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892673.408439:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031915d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3620:x1876835055534464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892673.408447:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 29 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.408453:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892673.408459:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3620:x1876835055533568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892673.408462:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 29 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.408462:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 29 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408469:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892673.408479:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 29 pid: 190664 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.408495:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99800/0xd5b980e0d62af691 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af68a expref: 29 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408496:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 29 pid: 190664 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.408520:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 28 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.408535:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892673.408535:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af683 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af67c expref: 28 pid: 190664 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.408537:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00010000:00010000:1.0:1789892673.408541:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98000/0xd5b980e0d62af659 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af652 expref: 28 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.408556:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055533952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892673.408556:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892673.408563:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892673.408568:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3620:x1876835055533440:12345-0@lo:103:ldlm_bl.0 Request processed in 147us (798us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892673.408570:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892673.408575:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00010000:00010000:3.0:1789892673.408581:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 26 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408600:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:0.0:1789892673.408601:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055533568:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892673.408608:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031915d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055534464:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892673.408611:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055534080:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892673.408616:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:1.0:1789892673.408626:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00010000:00010000:2.0:1789892673.408627:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892673.408633:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 24 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.408642:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00000100:00100000:0.0:1789892673.408650:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055534976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892673.408654:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892673.408658:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892673.408663:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408704:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 25 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408713:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055534848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892673.408717:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.408731:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408740:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892673.408757:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af675 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af66e expref: 23 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.408763:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af667 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af660 expref: 23 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.408771:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892673.408771:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af64b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af644 expref: 22 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408774:0:3621:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789892673.408784:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055535232:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892673.408799:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892673.408804:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892673.408809:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055533952:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.408815:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1789892673.408820:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892673.408839:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055534848 00000100:00100000:3.0:1789892673.408843:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055534848 00000100:00100000:2.0:1789892673.408845:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089b96c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3618:x1876835055534080:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (756us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892673.408853:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00010000:00010000:3.0:1789892673.408858:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 20 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408860:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535232 00000100:00100000:0.0:1789892673.408864:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055534976:12345-0@lo:103:ldlm_bl.0 Request processed in 212us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892673.408868:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535232 00000100:00100000:3.0:1789892673.408882:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:0.0:1789892673.408889:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00010000:00010000:1.0:1789892673.408892:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 20 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.408903:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055535104:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892673.408916:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1789892673.408933:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892673.408934:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3621:x1876835055535232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892673.408945:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892673.408953:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 19 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.408960:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535104 00000100:00100000:1.0:1789892673.408964:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535104 00010000:00010000:0.0:1789892673.408966:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 19 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.408969:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3621:x1876835055534848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892673.408995:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892673.408997:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 20 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.409002:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c400/0xd5b980e0d62af621 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af61a expref: 20 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409003:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 20 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.409027:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00010000:00010000:3.0:1789892673.409031:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 19 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.409040:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3619:x1876835055535104:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892673.409047:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055534976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892673.409047:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892673.409054:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af63d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af636 expref: 19 pid: 194990 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.409061:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892673.409066:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892673.409068:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055534080:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892673.409069:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 18 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892673.409082:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 18 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.409084:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055533952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892673.409103:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b749c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055535232:12345-0@lo:103:ldlm_bl.0 Request processed in 176us (282us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892673.409104:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af62f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af628 expref: 18 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.409112:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b748700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3621:x1876835055534848:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892673.409125:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00010000:00010000:1.0:1789892673.409130:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892673.409134:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1789892673.409142:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055533568:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892673.409153:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055533440:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892673.409166:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031915dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055534464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892673.409178:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055535232:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892673.409180:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055535104:12345-0@lo:103:ldlm_bl.0 Request processed in 143us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892673.409190:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1789892673.409194:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b749880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534592:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892673.409201:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055534848:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892673.409216:0:217130:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217130:1876835055534720:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892673.409220:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055535104:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892673.409256:0:217130:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892673.409370:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892673.409392:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892673.409393:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743680 00000100:00100000:2.0:1789892673.409397:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743680 00010000:00010000:2.0:1789892673.409412:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 10 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892673.409429:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743808 00000100:00100000:2.0:1789892673.409431:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743808 00010000:00010000:2.0:1789892673.409440:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 11 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.409455:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 541 00000100:00100000:3.0:1789892673.409464:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062743680:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789892673.409470:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 542 00010000:00010000:3.0:1789892673.409472:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892673.409478:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 11 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.409482:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062743808:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892673.409495:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892673.409496:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 11 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.409503:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 11 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.409523:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 11 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409524:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af60c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603e5 expref: 11 pid: 190662 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.409550:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98600/0xd5b980e0d62af613 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603ec expref: 10 pid: 190663 timeout: 3463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409552:0:202163:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409574:0:202163:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892673.409580:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892673.409584:0:202163:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409591:0:202163:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409596:0:202163:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409601:0:202163:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409605:0:202163:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6200 already unused, calling callback (ffffffffc0d27250) 00000100:00100000:0.0:1789892673.409607:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b748a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062743808:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 129us (214us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892673.409610:0:202163:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892673.409617:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 542 00010000:00010000:3.0:1789892673.409621:0:202163:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409637:0:202163:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892673.409646:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892673.409653:0:217130:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.409661:0:217130:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892673.409666:0:217130:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af698 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217130 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892673.409780:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062743680:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 212us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.409788:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 541 00000100:00100000:0.0:1789892673.553963:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055535360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789892673.554084:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892673.554128:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535360 00000100:00100000:3.0:1789892673.554150:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535360 00000100:00100000:3.0:1789892673.554198:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789892673.554207:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055535360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789892673.554227:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892673.554273:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055535360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 68us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892673.554279:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1789892673.554316:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055535360:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789892673.617871:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892674.235786:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892674.235821:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892674.235876:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744064 00000100:00100000:0.0:1789892674.235881:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062743936 00000100:00100000:2.0:1789892674.235887:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744064 00000100:00100000:1.0:1789892674.235888:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892674.235889:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062743936 00000100:00080000:1.0:1789892674.235945:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892674.235949:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2273 00000100:00100000:2.0:1789892674.235953:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744192 00000100:00100000:2.0:1789892674.235958:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744192 00000100:00100000:0.0:1789892674.235962:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2394:x1876835062743936:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892674.236000:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 495 00000100:00100000:1.0:1789892674.236035:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2395:x1876835062744064:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892674.236039:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 496 00000100:00100000:3.0:1789892674.236072:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2394:x1876835062744192:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1789892674.236076:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2394:x1876835062743936:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 112us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.236089:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2273 00000100:00100000:1.0:1789892674.236095:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2395:x1876835062744064:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 66us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892674.236107:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 495 00000100:00080000:1.0:1789892674.236141:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892674.236153:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2394:x1876835062744192:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 98us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.236161:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 496 00010000:00010000:3.0:1789892674.641853:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892674.897831:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892674.897840:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 177 10000000:01000000:1.0:1789892674.897870:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892674.897929:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.897940:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.897951:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.897991:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055535488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.898088:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.898141:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.898165:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535488 00000100:00100000:2.0:1789892674.898181:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535488 00000100:00100000:2.0:1789892674.898253:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2274 00000100:00100000:2.0:1789892674.898267:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055535488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892674.898286:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892674.898306:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af69f expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.898346:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.898360:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.898370:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382400, rc 0) 00000100:00100000:2.0:1789892674.898452:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055535488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 189us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.898476:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2274 00000100:00100000:1.0:1789892674.898506:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055535488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.898526:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.898535:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.898601:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055535616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.898630:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.898657:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.898702:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535616 00000100:00100000:0.0:1789892674.898708:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535616 00000100:00100000:0.0:1789892674.898741:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2275 00000100:00100000:0.0:1789892674.898747:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055535616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892674.898855:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055535616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.898864:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2275 00000100:00100000:1.0:1789892674.898879:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055535616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.898907:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055535744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.898945:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.898982:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.899040:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535744 00000100:00100000:3.0:1789892674.899050:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535744 00000100:00100000:3.0:1789892674.899107:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2276 00000100:00100000:3.0:1789892674.899120:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055535744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.899269:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055535744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.899280:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2276 00000100:00100000:1.0:1789892674.899290:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055535744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.899632:0:217135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217135:1876835055535872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.899718:0:217135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.899747:0:217135:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308b1a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.899778:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055535872 00000100:00100000:2.0:1789892674.899785:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055535872 00000100:00100000:2.0:1789892674.899825:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2277 00000100:00100000:2.0:1789892674.899834:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217135:x1876835055535872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.899961:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217135:x1876835055535872:12345-0@lo:502:llog_process_th.0 Request processed in 128us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.899988:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2277 00000100:00100000:3.0:1789892674.900028:0:217135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217135:1876835055535872:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.900088:0:217135:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217135:1876835055536000:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.900135:0:217135:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.900156:0:217135:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308b1a2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.900189:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536000 00000100:00100000:2.0:1789892674.900196:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536000 00000100:00100000:2.0:1789892674.900227:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2278 00000100:00100000:2.0:1789892674.900238:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217135:x1876835055536000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.900320:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217135:x1876835055536000:12345-0@lo:502:llog_process_th.0 Request processed in 85us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.900326:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2278 00000100:00100000:3.0:1789892674.900361:0:217135:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217135:1876835055536000:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892674.900391:0:217135:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:1.0:1789892674.900498:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:1.0:1789892674.900525:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892674.900532:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.900540:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892674.900548:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892674.900551:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:1.0:1789892674.900553:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892674.900572:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.900578:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.900585:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.900596:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.900620:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.900642:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.900669:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536128 00000100:00100000:0.0:1789892674.900674:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536128 00000100:00100000:0.0:1789892674.900724:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2279 00000100:00100000:0.0:1789892674.900732:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055536128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892674.900741:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892674.900751:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af6ad expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.900766:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 17 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.900776:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 17 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.900784:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98200, rc 0) 00000100:00100000:0.0:1789892674.900819:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055536128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.900826:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2279 00000100:00100000:1.0:1789892674.900837:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.900848:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.900858:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.900900:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.900920:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.900941:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.900980:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536256 00000100:00100000:3.0:1789892674.900988:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536256 00000100:00100000:3.0:1789892674.901026:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2280 00000100:00100000:3.0:1789892674.901039:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055536256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.901158:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055536256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.901168:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2280 00000100:00100000:1.0:1789892674.901195:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.901218:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.901254:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.901270:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.901315:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536384 00000100:00100000:2.0:1789892674.901321:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536384 00000100:00100000:2.0:1789892674.901350:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2281 00000100:00100000:2.0:1789892674.901358:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055536384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.901455:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055536384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 97us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.901464:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2281 00000100:00100000:1.0:1789892674.901476:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892674.902127:0:217136:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:1.0:1789892674.902230:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:1.0:1789892674.902243:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892674.902247:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.902255:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892674.902261:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892674.902262:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 177 10000000:01000000:1.0:1789892674.902264:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892674.902277:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.902282:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.902288:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.902304:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.902328:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.902350:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.902362:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536512 00000100:00100000:2.0:1789892674.902368:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536512 00000100:00100000:2.0:1789892674.902401:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2282 00000100:00100000:2.0:1789892674.902418:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055536512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892674.902425:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892674.902433:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af6bb expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.902445:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.902451:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.902456:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892674.902486:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055536512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.902491:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2282 00000100:00100000:1.0:1789892674.902516:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.902526:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.902531:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.902558:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.902577:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.902594:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.902624:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536640 00000100:00100000:0.0:1789892674.902629:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536640 00000100:00100000:0.0:1789892674.902658:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2283 00000100:00100000:0.0:1789892674.902665:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055536640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892674.902768:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055536640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.902776:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2283 00000100:00100000:1.0:1789892674.902787:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.902813:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.902844:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.902864:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.902881:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536768 00000100:00100000:3.0:1789892674.902888:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536768 00000100:00100000:3.0:1789892674.902917:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2284 00000100:00100000:3.0:1789892674.902923:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055536768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.903013:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055536768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.903020:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2284 00000100:00100000:1.0:1789892674.903041:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055536768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.903265:0:217137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217137:1876835055536896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.903316:0:217137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.903341:0:217137:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.903358:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055536896 00000100:00100000:2.0:1789892674.903367:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055536896 00000100:00100000:2.0:1789892674.903402:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2285 00000100:00100000:2.0:1789892674.903408:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217137:x1876835055536896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.903489:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217137:x1876835055536896:12345-0@lo:502:llog_process_th.0 Request processed in 82us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.903495:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2285 00000100:00100000:3.0:1789892674.903525:0:217137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217137:1876835055536896:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.903563:0:217137:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217137:1876835055537024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.903595:0:217137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.903617:0:217137:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081e1e840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.903631:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537024 00000100:00100000:2.0:1789892674.903636:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537024 00000100:00100000:2.0:1789892674.903658:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2286 00000100:00100000:2.0:1789892674.903666:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217137:x1876835055537024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.903759:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217137:x1876835055537024:12345-0@lo:502:llog_process_th.0 Request processed in 95us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.903772:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2286 00000100:00100000:3.0:1789892674.903784:0:217137:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217137:1876835055537024:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892674.903806:0:217137:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:1.0:1789892674.903897:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:1.0:1789892674.903912:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892674.903917:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.903924:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892674.903938:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892674.903940:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:1.0:1789892674.903942:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892674.903957:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.903975:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.903981:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.903993:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537152:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.904019:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.904048:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.904066:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537152 00000100:00100000:0.0:1789892674.904071:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537152 00000100:00100000:0.0:1789892674.904099:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2287 00000100:00100000:0.0:1789892674.904107:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055537152:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892674.904121:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892674.904130:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af6c9 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.904144:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.904154:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.904161:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892674.904194:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055537152:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.904201:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2287 00000100:00100000:1.0:1789892674.904220:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537152:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.904233:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.904242:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.904275:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.904295:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.904310:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.904333:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537280 00000100:00100000:3.0:1789892674.904338:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537280 00000100:00100000:3.0:1789892674.904365:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2288 00000100:00100000:3.0:1789892674.904370:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055537280:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.904443:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055537280:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.904449:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2288 00000100:00100000:1.0:1789892674.904462:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537280:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.904492:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537408:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.904526:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.904540:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.904556:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537408 00000100:00100000:2.0:1789892674.904560:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537408 00000100:00100000:2.0:1789892674.904586:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2289 00000100:00100000:2.0:1789892674.904590:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055537408:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.904653:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055537408:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.904659:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2289 00000100:00100000:1.0:1789892674.904665:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537408:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892674.905276:0:217138:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:1.0:1789892674.905321:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:1.0:1789892674.905339:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892674.905344:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.905350:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892674.905355:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892674.905356:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 177 10000000:01000000:1.0:1789892674.905358:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892674.905369:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.905374:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.905379:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.905387:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.905407:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.905425:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.905437:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537536 00000100:00100000:2.0:1789892674.905442:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537536 00000100:00100000:2.0:1789892674.905463:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2290 00000100:00100000:2.0:1789892674.905467:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055537536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892674.905473:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892674.905483:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af6d7 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.905495:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.905501:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.905505:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383e00, rc 0) 00000100:00100000:2.0:1789892674.905537:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055537536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.905541:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2290 00000100:00100000:1.0:1789892674.905562:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.905579:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.905584:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.905610:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.905630:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.905646:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.905674:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537664 00000100:00100000:0.0:1789892674.905706:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537664 00000100:00100000:0.0:1789892674.905736:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2291 00000100:00100000:0.0:1789892674.905746:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055537664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892674.905819:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055537664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.905827:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2291 00000100:00100000:1.0:1789892674.905837:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.905861:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.905892:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.905912:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.905924:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537792 00000100:00100000:3.0:1789892674.905930:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537792 00000100:00100000:3.0:1789892674.905958:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2292 00000100:00100000:3.0:1789892674.905981:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055537792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.906054:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055537792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.906065:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2292 00000100:00100000:1.0:1789892674.906085:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055537792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.906310:0:217139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217139:1876835055537920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.906352:0:217139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.906369:0:217139:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.906388:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055537920 00000100:00100000:2.0:1789892674.906396:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055537920 00000100:00100000:2.0:1789892674.906421:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2293 00000100:00100000:2.0:1789892674.906426:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217139:x1876835055537920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.906503:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217139:x1876835055537920:12345-0@lo:502:llog_process_th.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.906509:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2293 00000100:00100000:3.0:1789892674.906539:0:217139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217139:1876835055537920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.906575:0:217139:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217139:1876835055538048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.906605:0:217139:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.906620:0:217139:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031985b7a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.906637:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538048 00000100:00100000:2.0:1789892674.906641:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538048 00000100:00100000:2.0:1789892674.906664:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2294 00000100:00100000:2.0:1789892674.906671:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217139:x1876835055538048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.906766:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217139:x1876835055538048:12345-0@lo:502:llog_process_th.0 Request processed in 93us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.906772:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2294 00000100:00100000:3.0:1789892674.906778:0:217139:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217139:1876835055538048:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892674.906805:0:217139:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:1.0:1789892674.906896:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:1.0:1789892674.906911:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892674.906916:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.906923:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892674.906930:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892674.906931:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 203 10000000:01000000:1.0:1789892674.906933:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892674.906948:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.906978:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.906985:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.906998:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.907024:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.907053:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.907071:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538176 00000100:00100000:0.0:1789892674.907077:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538176 00000100:00100000:0.0:1789892674.907110:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2295 00000100:00100000:0.0:1789892674.907118:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055538176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892674.907126:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892674.907134:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af6e5 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.907155:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.907165:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.907172:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99400, rc 0) 00000100:00100000:0.0:1789892674.907207:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055538176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.907214:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2295 00000100:00100000:1.0:1789892674.907239:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.907252:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.907261:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.907292:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.907311:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.907326:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.907357:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538304 00000100:00100000:3.0:1789892674.907365:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538304 00000100:00100000:3.0:1789892674.907401:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2296 00000100:00100000:3.0:1789892674.907411:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055538304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892674.907502:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055538304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 91us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.907514:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2296 00000100:00100000:1.0:1789892674.907521:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.907548:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.907583:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.907597:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.907610:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538432 00000100:00100000:2.0:1789892674.907615:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538432 00000100:00100000:2.0:1789892674.907641:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2297 00000100:00100000:2.0:1789892674.907645:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055538432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.907729:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055538432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.907735:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2297 00000100:00100000:1.0:1789892674.907753:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.907954:0:217140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217140:1876835055538560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.907999:0:217140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.908019:0:217140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.908041:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538560 00000100:00100000:0.0:1789892674.908046:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538560 00000100:00100000:0.0:1789892674.908075:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2298 00000100:00100000:0.0:1789892674.908081:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217140:x1876835055538560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892674.908164:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217140:x1876835055538560:12345-0@lo:502:llog_process_th.0 Request processed in 83us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.908171:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2298 00000100:00100000:2.0:1789892674.908188:0:217140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217140:1876835055538560:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892674.908213:0:217140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892674.908226:0:217140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892674.908228:0:217140:0:(obd_config.c:1561:class_process_config()) marker 191 (0x1) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892674.908232:0:217140:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:2.0:1789892674.908246:0:217140:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000100:00100000:2.0:1789892674.908260:0:217140:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217140:1876835055538688:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892674.908285:0:217140:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.908299:0:217140:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213a840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.908316:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538688 00000100:00100000:0.0:1789892674.908320:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538688 00000100:00100000:0.0:1789892674.908340:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2299 00000100:00100000:0.0:1789892674.908345:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217140:x1876835055538688:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892674.908401:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217140:x1876835055538688:12345-0@lo:502:llog_process_th.0 Request processed in 55us (114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.908407:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2299 00000100:00100000:2.0:1789892674.908419:0:217140:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217140:1876835055538688:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892674.908440:0:217140:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892674.908444:0:217140:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892674.908445:0:217140:0:(obd_config.c:1561:class_process_config()) marker 191 (0x2) lustre-MDT0001-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892674.908448:0:217140:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 206 count 202 00000020:01000000:1.0:1789892674.908507:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 203-205 (rc=0) 10000000:01000000:1.0:1789892674.908524:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892674.908529:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.908534:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892674.908540:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892674.908542:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 177 10000000:01000000:1.0:1789892674.908543:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892674.908554:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.908559:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.908564:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.908573:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.908593:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.908607:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.908638:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538816 00000100:00100000:3.0:1789892674.908646:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538816 00000100:00100000:3.0:1789892674.908713:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2300 00000100:00100000:3.0:1789892674.908722:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055538816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892674.908732:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892674.908745:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af6f3 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892674.908767:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892674.908778:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892674.908788:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d800, rc 0) 00000100:00100000:3.0:1789892674.908833:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055538816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.908842:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2300 00000100:00100000:1.0:1789892674.908867:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892674.908880:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892674.908887:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892674.908914:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.908942:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.908975:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892674.908984:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055538944 00000100:00100000:2.0:1789892674.908989:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055538944 00000100:00100000:2.0:1789892674.909014:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2301 00000100:00100000:2.0:1789892674.909019:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055538944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.909080:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055538944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892674.909087:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2301 00000100:00100000:1.0:1789892674.909093:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055538944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.909116:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.909143:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.909160:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.909181:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539072 00000100:00100000:0.0:1789892674.909186:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539072 00000100:00100000:0.0:1789892674.909218:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2302 00000100:00100000:0.0:1789892674.909227:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055539072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892674.909293:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055539072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.909300:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2302 00000100:00100000:1.0:1789892674.909305:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.909499:0:217141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217141:1876835055539200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892674.909526:0:217141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.909542:0:217141:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371c540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.909567:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539200 00000100:00100000:0.0:1789892674.909571:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539200 00000100:00100000:0.0:1789892674.909596:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2303 00000100:00100000:0.0:1789892674.909603:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217141:x1876835055539200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892674.909676:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217141:x1876835055539200:12345-0@lo:502:llog_process_th.0 Request processed in 73us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.909705:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2303 00000100:00100000:1.0:1789892674.909710:0:217141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217141:1876835055539200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892674.909746:0:217141:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217141:1876835055539328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892674.909777:0:217141:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.909799:0:217141:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371c540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.909812:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539328 00000100:00100000:3.0:1789892674.909824:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539328 00000100:00100000:3.0:1789892674.909853:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2304 00000100:00100000:3.0:1789892674.909858:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217141:x1876835055539328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.909938:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217141:x1876835055539328:12345-0@lo:502:llog_process_th.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.909945:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2304 00000100:00100000:1.0:1789892674.909956:0:217141:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217141:1876835055539328:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892674.909994:0:217141:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000020:01000000:2.0:1789892674.910057:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 177-179 (rc=0) 10000000:01000000:2.0:1789892674.910073:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892674.910078:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.910085:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892674.910091:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892674.910098:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 203 10000000:01000000:2.0:1789892674.910100:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892674.910113:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.910118:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.910124:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892674.910133:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.910157:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.910174:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.910201:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539456 00000100:00100000:0.0:1789892674.910206:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539456 00000100:00100000:0.0:1789892674.910237:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2305 00000100:00100000:0.0:1789892674.910244:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055539456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892674.910253:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892674.910262:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af701 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.910277:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.910287:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.910296:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98800, rc 0) 00000100:00100000:0.0:1789892674.910333:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055539456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 90us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.910348:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2305 00000100:00100000:2.0:1789892674.910351:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892674.910365:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.910371:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892674.910403:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.910422:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.910435:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.910454:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539584 00000100:00100000:0.0:1789892674.910458:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539584 00000100:00100000:0.0:1789892674.910478:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2306 00000100:00100000:0.0:1789892674.910482:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055539584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892674.910545:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055539584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.910551:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2306 00000100:00100000:2.0:1789892674.910556:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.910579:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.910607:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.910626:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892674.910641:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539712 00000100:00100000:1.0:1789892674.910645:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539712 00000100:00100000:1.0:1789892674.910670:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2307 00000100:00100000:1.0:1789892674.910708:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055539712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.910782:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055539712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 105us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892674.910787:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2307 00000100:00100000:2.0:1789892674.910791:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055539712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.910978:0:217142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217142:1876835055539840:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892674.911006:0:217142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892674.911025:0:217142:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308371c480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892674.911046:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539840 00000100:00100000:3.0:1789892674.911054:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539840 00000100:00100000:3.0:1789892674.911089:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2308 00000100:00100000:3.0:1789892674.911096:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217142:x1876835055539840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.911215:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217142:x1876835055539840:12345-0@lo:502:llog_process_th.0 Request processed in 118us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892674.911227:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2308 00000100:00100000:1.0:1789892674.911238:0:217142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217142:1876835055539840:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789892674.911262:0:217142:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892674.911268:0:217142:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892674.911270:0:217142:0:(obd_config.c:1561:class_process_config()) marker 190 (0x1) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:1.0:1789892674.911274:0:217142:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:1.0:1789892674.911280:0:217142:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool1 00000020:01000004:1.0:1789892674.911599:0:217143:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1789892674.911603:0:217143:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:3.0:1789892674.911639:0:217142:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217142:1876835055539968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892674.911711:0:217142:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892674.911771:0:217142:0:(client.c:2702:ptlrpc_set_wait()) set ffff903194794840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.911776:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055539968 00000100:00100000:0.0:1789892674.911784:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055539968 00000100:00100000:0.0:1789892674.911827:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2309 00000100:00100000:0.0:1789892674.911836:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217142:x1876835055539968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892674.911933:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217142:x1876835055539968:12345-0@lo:502:llog_process_th.0 Request processed in 96us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.911943:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2309 00000100:00100000:3.0:1789892674.911954:0:217142:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217142:1876835055539968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892674.911995:0:217142:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892674.912001:0:217142:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892674.912003:0:217142:0:(obd_config.c:1561:class_process_config()) marker 190 (0x2) lustre-MDT0000-m rem lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:3.0:1789892674.912006:0:217142:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 206 count 202 00000020:01000000:2.0:1789892674.912066:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 203-205 (rc=0) 10000000:01000000:2.0:1789892674.912092:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892674.912097:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.912103:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892674.912108:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892674.912109:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:2.0:1789892674.912111:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892674.912124:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.912130:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.912135:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892674.912145:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055540096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.912165:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.912180:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c86c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892674.912199:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055540096 00000100:00100000:0.0:1789892674.912203:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055540096 00000100:00100000:0.0:1789892674.912224:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2310 00000100:00100000:0.0:1789892674.912230:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055540096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892674.912236:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892674.912243:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af70f expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.912253:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.912259:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892674.912270:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98a00, rc 0) 00000100:00100000:0.0:1789892674.912300:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055540096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892674.912305:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2310 00000100:00100000:2.0:1789892674.912325:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055540096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892674.912337:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.912352:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892674.912379:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055540224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892674.912398:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892674.912411:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c86c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892674.912428:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055540224 00000100:00100000:1.0:1789892674.912432:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055540224 00000100:00100000:1.0:1789892674.912457:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2311 00000100:00100000:1.0:1789892674.912464:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055540224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892674.912521:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055540224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 57us (121us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892674.912530:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2311 00000100:00100000:2.0:1789892674.912540:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055540224:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892674.912561:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892674.912565:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892674.912570:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.131943:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892675.132037:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744320 00000100:00100000:3.0:1789892675.132053:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744320 00000100:00100000:3.0:1789892675.132117:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2312 00000100:00100000:3.0:1789892675.132128:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062744320:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892675.132149:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892675.132187:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603f3 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.132220:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.132231:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.132241:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d400, rc 0) 00000100:00100000:3.0:1789892675.132305:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062744320:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 180us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892675.132311:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2312 00000100:00100000:2.0:1789892675.133246:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892675.133303:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744448 00000100:00100000:0.0:1789892675.133311:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744448 00000100:00100000:0.0:1789892675.133359:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2313 00000100:00100000:0.0:1789892675.133370:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062744448:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892675.133507:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062744448:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 139us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892675.133514:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2313 00000100:00100000:1.0:1789892675.134176:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892675.134219:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744576 00000100:00100000:0.0:1789892675.134223:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744576 00000100:00100000:0.0:1789892675.134246:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2314 00000100:00100000:0.0:1789892675.134252:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062744576:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892675.134340:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062744576:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 88us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892675.134346:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2314 00000100:00100000:2.0:1789892675.135639:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892675.135723:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744704 00000100:00100000:1.0:1789892675.135730:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744704 00000100:00100000:1.0:1789892675.135766:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2315 00000100:00100000:1.0:1789892675.135775:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216148:x1876835062744704:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892675.135877:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216148:x1876835062744704:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 104us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892675.135883:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2315 00000100:00100000:2.0:1789892675.136597:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892675.136639:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744832 00000100:00100000:3.0:1789892675.136645:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744832 00000100:00100000:3.0:1789892675.136672:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2316 00000100:00100000:3.0:1789892675.136712:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216148:x1876835062744832:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892675.136808:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216148:x1876835062744832:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 129us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892675.136814:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2316 00000100:00100000:2.0:1789892675.137675:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892675.137741:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062744960 00000100:00100000:0.0:1789892675.137750:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062744960 00000100:00100000:0.0:1789892675.137795:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2317 00000100:00100000:0.0:1789892675.137809:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062744960:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892675.137822:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892675.137843:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a2603fa expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.137865:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.137874:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.137881:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99c00, rc 0) 00000100:00100000:0.0:1789892675.137938:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062744960:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 135us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892675.137947:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2317 00000100:00100000:2.0:1789892675.138638:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892675.138705:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745088 00000100:00100000:0.0:1789892675.138711:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745088 00000100:00100000:0.0:1789892675.138736:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2318 00000100:00100000:0.0:1789892675.138741:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062745088:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892675.138797:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062745088:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 56us (162us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892675.138804:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2318 00010000:00010000:1.0:1789892675.665828:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892675.992818:0:217241:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc3b52c1a0 20000000:00000080:1.0:1789892675.992834:0:217241:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff9030837ec400 uarg=0000000000000000 00000040:00100000:1.0:1789892675.993359:0:217241:0:(llog.c:1072:llog_reverse_process()) index 179 : idx 137 20000000:01000000:1.0:1789892675.993365:0:217241:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 178 cmd:0xce022 lustre.qpool1 lustre-OST0001_UUID 20000000:01000000:1.0:1789892675.993379:0:217241:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool1 fl=4 20000000:01000000:1.0:1789892675.993647:0:217242:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 159 marker 171 1->4: lustre-clilov new lustre.qpool1 20000000:01000000:1.0:1789892675.993733:0:217242:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 161 marker 171 2->4: lustre-clilov new lustre.qpool1 00000040:00080000:1.0:1789892675.993756:0:217242:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 180 count 177 00000040:00080000:3.0:1789892675.993900:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].181, 224 off41184 20000000:01000000:3.0:1789892675.993915:0:217241:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:3.0:1789892675.993926:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].182, 104 off41288 00000040:00080000:3.0:1789892675.993937:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].183, 224 off41512 20000000:01000000:3.0:1789892675.993947:0:217241:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892675.994214:0:217243:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 185 marker 172 1->4: lustre-MDT0000-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892675.994234:0:217243:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 187 marker 172 2->4: lustre-MDT0000-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892675.994255:0:217243:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 206 count 202 00000040:00080000:1.0:1789892675.994374:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].206, 224 off45984 20000000:01000000:1.0:1789892675.994386:0:217241:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789892675.994402:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].207, 112 off46096 00000040:00080000:1.0:1789892675.994418:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].208, 224 off46320 20000000:01000000:1.0:1789892675.994428:0:217241:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool1 fl=4 20000000:01000000:3.0:1789892675.994644:0:217244:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 185 marker 173 1->4: lustre-MDT0001-mdtlov new lustre.qpool1 20000000:01000000:3.0:1789892675.994660:0:217244:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 187 marker 173 2->4: lustre-MDT0001-mdtlov new lustre.qpool1 00000040:00080000:3.0:1789892675.994671:0:217244:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 206 count 202 00000040:00080000:1.0:1789892675.994753:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].206, 224 off45984 20000000:01000000:1.0:1789892675.994761:0:217241:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool1 (null) (null) 00000040:00080000:1.0:1789892675.994770:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].207, 112 off46096 00000040:00080000:1.0:1789892675.994779:0:217241:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].208, 224 off46320 10000000:01000000:1.0:1789892675.994786:0:217241:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892675.994807:0:217241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994828:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994838:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994846:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994855:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994873:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994882:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994891:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994900:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994909:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994920:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994930:0:217241:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.994940:0:217241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.995006:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.995024:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 9 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995056:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540352:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892675.995176:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.995187:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 9 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995197:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b749880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540480:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892675.995234:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.995245:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 23 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995255:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b74a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540608:0@lo:104: 00000100:00100000:1.0:1789892675.995317:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892675.995356:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.995366:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 23 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995376:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b74bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540736:0@lo:104: 00000100:00100000:3.0:1789892675.995378:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055540608 00000100:00100000:3.0:1789892675.995387:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055540608 00000100:00100000:1.0:1789892675.995404:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892675.995449:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055540736 00010000:00010000:1.0:1789892675.995450:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.995458:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055540736 00000100:00100000:3.0:1789892675.995470:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 491 00010000:00010000:1.0:1789892675.995478:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 23 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.995486:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217241:x1876835055540608:12345-0@lo:104: 00000100:00100000:1.0:1789892675.995498:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540864:0@lo:104: 00000100:00100000:2.0:1789892675.995509:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 492 00000100:00100000:2.0:1789892675.995528:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217241:x1876835055540736:12345-0@lo:104: 00000100:00100000:1.0:1789892675.995531:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892675.995536:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.995545:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.995552:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055540864 00000100:00100000:0.0:1789892675.995560:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055540864 00010000:00010000:1.0:1789892675.995569:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.995581:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 23 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995590:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540992:0@lo:104: 00000100:00100000:0.0:1789892675.995596:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 493 00010000:00010000:3.0:1789892675.995607:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892675.995608:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055540864:12345-0@lo:104: 00000100:00100000:3.0:1789892675.995618:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b749f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055540608:12345-0@lo:104: Request processed in 136us (301us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892675.995621:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892675.995624:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995630:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892675.995631:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 491 00000100:00100000:2.0:1789892675.995637:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055540736:12345-0@lo:104: Request processed in 112us (228us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892675.995654:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.995657:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 492 00010000:00010000:1.0:1789892675.995669:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 23 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995698:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541120:0@lo:104: 00000100:00100000:2.0:1789892675.995716:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055540992 00000100:00100000:2.0:1789892675.995724:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055540992 00000100:00100000:1.0:1789892675.995726:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892675.995755:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541120 00010000:00010000:0.0:1789892675.995759:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789892675.995760:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541120 00010000:00010000:1.0:1789892675.995772:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.995772:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:217241:x1876835055540864:12345-0@lo:104: Request processed in 166us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892675.995785:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 494 00010000:00010000:1.0:1789892675.995796:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 23 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.995797:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1789892675.995802:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055540992:12345-0@lo:104: 00000100:00100000:0.0:1789892675.995811:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 493 00000100:00100000:2.0:1789892675.995816:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055541120:12345-0@lo:104: 00010000:00010000:3.0:1789892675.995817:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995823:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541248:0@lo:104: 00010000:00010000:2.0:1789892675.995835:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.995842:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892675.995851:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.995861:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892675.995866:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.995876:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.995880:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892675.995883:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892675.995892:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217241:x1876835055540992:12345-0@lo:104: Request processed in 96us (268us total) trans 0 rc 0/0 10000000:00010000:0.0:1789892675.995893:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.995903:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 494 00010000:00010000:2.0:1789892675.995905:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:0.0:1789892675.995910:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892675.995912:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.995918:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217241:x1876835055541120:12345-0@lo:104: Request processed in 105us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892675.995925:0:190653:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892675.995926:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 23 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.995935:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 495 00000100:00100000:3.0:1789892675.995940:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541248 00000100:00100000:1.0:1789892675.995944:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541376:0@lo:104: 00000100:00100000:3.0:1789892675.995945:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541248 00010000:00010000:0.0:1789892675.995970:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.995980:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789892675.995980:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892675.995988:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.995995:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789892675.995998:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892675.996008:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892675.996009:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996010:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903091829850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217241:x1876835055541248:12345-0@lo:104: 10000000:00010000:2.0:1789892675.996016:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.996024:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996031:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996032:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383a00/0xd5b980e0d62af70f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af716 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996046:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.996050:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 23 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892675.996075:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.996076:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c67b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541632:0@lo:104: 00010000:00010000:3.0:1789892675.996082:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:0.0:1789892675.996089:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:01000000:2.0:1789892675.996092:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892675.996093:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903091829850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217241:x1876835055541248:12345-0@lo:104: Request processed in 85us (212us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892675.996096:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996102:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496 00000100:00100000:1.0:1789892675.996109:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892675.996117:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892675.996121:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996130:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996131:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.996133:0:217241:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.996160:0:217241:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 23 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996161:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892675.996163:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996178:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.996179:0:217241:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541888:0@lo:104: 10000000:01000000:0.0:1789892675.996179:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892675.996195:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382000/0xd5b980e0d62af701 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af708 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996201:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541376 00000100:00100000:3.0:1789892675.996206:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541376 00000100:00100000:1.0:1789892675.996210:0:217241:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892675.996211:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892675.996213:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996217:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996224:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541632 00000100:00100000:1.0:1789892675.996225:0:217241:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892675.996229:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541632 00010000:00010000:0.0:1789892675.996233:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892675.996240:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7c00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892675.996245:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541888 10000000:00010000:2.0:1789892675.996245:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996249:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541888 00000100:00100000:1.0:1789892675.996255:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b74a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540608:0@lo:104: 00010000:00010000:0.0:1789892675.996261:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996263:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996267:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789892675.996270:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b74bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540736:0@lo:104: 00000100:00100000:3.0:1789892675.996280:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055541376:12345-0@lo:104: 00000100:00100000:1.0:1789892675.996287:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540864:0@lo:104: 00010000:00010000:0.0:1789892675.996291:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62af6f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6fa expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892675.996293:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996295:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.996310:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540992:0@lo:104: 10000000:01000000:2.0:1789892675.996323:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892675.996326:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892675.996333:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541120:0@lo:104: 00010000:00010000:0.0:1789892675.996333:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996348:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.996348:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c67100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541248:0@lo:104: 00010000:00010000:3.0:1789892675.996362:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892675.996366:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c66680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541376:0@lo:104: 00010000:00010000:2.0:1789892675.996376:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892675.996377:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217241:x1876835055541376:12345-0@lo:104: Request processed in 97us (382us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892675.996379:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7a00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892675.996387:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996391:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00010000:00010000:2.0:1789892675.996392:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996413:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892675.996435:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996437:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62af6e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6ec expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892675.996449:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892675.996452:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00010000:00010000:2.0:1789892675.996459:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892675.996464:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217241:x1876835055541632:12345-0@lo:104: 00010000:00010000:2.0:1789892675.996467:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996472:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996474:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996481:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892675.996489:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996500:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892675.996508:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996511:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996520:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:2.0:1789892675.996524:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996527:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62af6d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6de expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996537:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217241:x1876835055541632:12345-0@lo:104: Request processed in 73us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892675.996545:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c67b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541632:0@lo:104: 10000000:01000000:2.0:1789892675.996549:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892675.996556:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00010000:00010000:0.0:1789892675.996564:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892675.996570:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996576:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00010000:00010000:2.0:1789892675.996580:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996584:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892675.996589:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217241:x1876835055541888:12345-0@lo:104: 10000000:00010000:0.0:1789892675.996592:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996602:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996604:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892675.996615:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996636:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6000/0xd5b980e0d62af6c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6d0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996637:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996641:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789892675.996649:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055541888:0@lo:104: 00000100:00100000:3.0:1789892675.996654:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217241:x1876835055541888:12345-0@lo:104: Request processed in 66us (445us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892675.996664:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:0.0:1789892675.996666:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.996667:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 10000000:01000000:0.0:1789892675.996705:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892675.996706:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996707:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789892675.996715:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996721:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892675.996724:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892675.996727:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892675.996729:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996730:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996753:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996756:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892675.996758:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892675.996765:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996767:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892675.996775:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892675.996781:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789892675.996796:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892675.996797:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af6bb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6c2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996803:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996815:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892675.996822:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892675.996822:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.996822:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892675.996828:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892675.996832:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.996837:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892675.996843:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7200/0xd5b980e0d62af69f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6a6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.996847:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892675.996850:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996854:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892675.996858:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892675.996860:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892675.996866:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6800/0xd5b980e0d62af6ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af6b4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.996868:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892675.996887:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892675.996891:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892675.996896:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892675.996899:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892675.996900:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892675.996915:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055541504:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892675.996923:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055541760:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.996947:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542016 00000100:00100000:0.0:1789892675.996949:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.996969:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542016 00000100:00100000:2.0:1789892675.996980:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892675.997003:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 24 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997015:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892675.997019:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055542272:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.997053:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541504 00000100:00100000:1.0:1789892675.997059:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541504 00000100:00100000:0.0:1789892675.997060:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789892675.997072:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892675.997076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892675.997082:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 25 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.997111:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542528 00000100:00100000:2.0:1789892675.997113:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055542784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.997118:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542528 00000100:00100000:0.0:1789892675.997121:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892675.997129:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542272 00000100:00100000:3.0:1789892675.997134:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542272 00010000:00010000:3.0:1789892675.997155:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 27 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997156:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892675.997160:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 27 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.997172:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542144 00000100:00100000:2.0:1789892675.997175:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892675.997178:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542144 00010000:00010000:3.0:1789892675.997196:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 28 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.997199:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542784 00000100:00100000:1.0:1789892675.997205:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542784 00000100:00100000:3.0:1789892675.997220:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 00000100:00100000:0.0:1789892675.997220:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892675.997224:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 29 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.997233:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:3.0:1789892675.997235:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089b95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3620:x1876835055542016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892675.997249:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892675.997253:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542656 00000100:00100000:2.0:1789892675.997254:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3618:x1876835055541504:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.997256:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542656 00010000:00010000:3.0:1789892675.997258:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 29 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.997273:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997273:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00010000:00010000:2.0:1789892675.997275:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892675.997288:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997292:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3618:x1876835055542272:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892675.997296:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 30 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.997312:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892675.997316:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00010000:00010000:2.0:1789892675.997326:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.997326:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.997327:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+30:3620:x1876835055542528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892675.997341:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892675.997349:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.997360:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af6fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af6f3 expref: 30 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.997367:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af716 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af70f expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.997369:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 19 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 30 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.997394:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 28 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.997403:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892675.997410:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892675.997411:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af6de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af6d7 expref: 28 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.997417:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af6c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af6bb expref: 28 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.997433:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892675.997434:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892675.997461:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089b95850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3620:x1876835055542016:12345-0@lo:103:ldlm_bl.0 Request processed in 229us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892675.997468:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3618:x1876835055541504:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892675.997477:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00000100:00100000:2.0:1789892675.997485:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789892675.997496:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055542528:12345-0@lo:103:ldlm_bl.0 Request processed in 169us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892675.997496:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055542272:12345-0@lo:103:ldlm_bl.0 Request processed in 205us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892675.997508:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:2.0:1789892675.997516:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:0.0:1789892675.997524:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:2.0:1789892675.997530:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055542144:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.997535:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00000100:00100000:3.0:1789892675.997546:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00010000:00010000:2.0:1789892675.997549:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892675.997551:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055542784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892675.997559:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 22 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.997561:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055542656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892675.997561:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892675.997570:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 22 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.997577:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892675.997589:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 22 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892675.997590:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 22 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997591:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1789892675.997627:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 22 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997639:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:3.0:1789892675.997643:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 22 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997656:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745216 00010000:00010000:2.0:1789892675.997659:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99400/0xd5b980e0d62af6ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af6e5 expref: 22 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.997662:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af6b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af6ad expref: 22 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997662:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745216 00010000:00010000:3.0:1789892675.997667:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382400/0xd5b980e0d62af6a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af69f expref: 22 pid: 190664 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.997714:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 10 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.997716:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892675.997721:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892675.997737:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892675.997747:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745344 00000100:00100000:0.0:1789892675.997752:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745344 00000100:00100000:2.0:1789892675.997769:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ee2d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055542144:12345-0@lo:103:ldlm_bl.0 Request processed in 243us (653us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892675.997771:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 11 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.997775:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055542656:12345-0@lo:103:ldlm_bl.0 Request processed in 215us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892675.997782:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3618:x1876835055542784:12345-0@lo:103:ldlm_bl.0 Request processed in 233us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892675.997794:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1789892675.997805:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789892675.997813:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:2.0:1789892675.997823:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 550 00000100:00100000:0.0:1789892675.997835:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 551 00000100:00100000:2.0:1789892675.997839:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062745216:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892675.997850:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892675.997860:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 11 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.997861:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062745344:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892675.997878:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892675.997880:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 11 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.997890:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540352:192.168.203.53@tcp:104: 00010000:00010000:0.0:1789892675.997891:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 11 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.997892:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892675.997905:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892675.997912:0:217241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d400/0xd5b980e0d62af71d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603f3 expref: 11 pid: 190662 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.997915:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 11 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.997928:0:217241:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b749880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217241:1876835055540480:192.168.203.53@tcp:104: 00000100:00100000:3.0:1789892675.997938:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055542400:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892675.997939:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af724 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a2603fa expref: 10 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.997948:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2396:x1876835062745216:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 112us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892675.997977:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 550 00010000:00010000:0.0:1789892675.997982:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892675.997993:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892675.997998:0:217241:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.998004:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055541760 00000100:00100000:2.0:1789892675.998011:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055541760 00000100:00100000:0.0:1789892675.998016:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062745344:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 159us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892675.998023:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 551 00010000:00010000:2.0:1789892675.998031:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 17 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.998033:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542400 00000100:00100000:3.0:1789892675.998039:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542400 00010000:00010000:3.0:1789892675.998058:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 18 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892675.998062:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892675.998071:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00000100:00100000:0.0:1789892675.998082:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892675.998089:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3619:x1876835055541760:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.998091:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 553 00000100:00100000:0.0:1789892675.998096:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892675.998109:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309210c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3619:x1876835055542400:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892675.998110:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055542528:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892675.998112:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892675.998124:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 18 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.998129:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892675.998132:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055541504:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892675.998140:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 18 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998145:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 18 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.998150:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055542272:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892675.998170:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055542784:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892675.998175:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 18 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998194:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af708 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af701 expref: 18 pid: 190663 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.998200:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af6d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af6c9 expref: 18 pid: 194990 timeout: 3466 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998214:0:191420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998226:0:191420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892675.998234:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892675.998239:0:191420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998250:0:191420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998259:0:191420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998267:0:191420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998275:0:191420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7600 already unused, calling callback (ffffffffc0d27250) 00000100:00100000:1.0:1789892675.998279:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309210c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055542400:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (285us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892675.998284:0:191420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892675.998303:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 553 00010000:00010000:2.0:1789892675.998313:0:191420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892675.998334:0:191420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892675.998340:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055542400:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892675.998350:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892675.998376:0:217241:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892675.998387:0:217241:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.998393:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055541760:12345-0@lo:103:ldlm_bl.0 Request processed in 308us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892675.998399:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055541760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892675.998403:0:217241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7600/0xd5b980e0d62af72b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892675.998414:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 10000000:01000000:3.0:1789892676.105823:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892676.105833:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 180 10000000:01000000:3.0:1789892676.105841:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892676.105907:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.105922:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.105936:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.105991:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055542912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.106088:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.106156:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892676.106156:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055542912 00000100:00100000:2.0:1789892676.106167:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055542912 00000100:00100000:2.0:1789892676.106231:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2319 00000100:00100000:2.0:1789892676.106240:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055542912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.106256:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892676.106270:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af732 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.106294:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.106304:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.106313:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382000, rc 0) 00000100:00100000:2.0:1789892676.106357:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055542912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.106363:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2319 00000100:00100000:3.0:1789892676.106412:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055542912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892676.106432:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.106444:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.106522:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.106553:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.106578:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.106628:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543040 00000100:00100000:1.0:1789892676.106635:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543040 00000100:00100000:1.0:1789892676.106672:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2320 00000100:00100000:1.0:1789892676.106710:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055543040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.106850:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055543040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 145us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.106856:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2320 00000100:00100000:3.0:1789892676.106897:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.106929:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.106989:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.107017:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.107043:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543168 00000100:00100000:0.0:1789892676.107048:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543168 00000100:00100000:0.0:1789892676.107079:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2321 00000100:00100000:0.0:1789892676.107090:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055543168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.107202:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055543168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.107209:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2321 00000100:00100000:3.0:1789892676.107238:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.107602:0:217245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217245:1876835055543296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.107640:0:217245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.107660:0:217245:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.107705:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543296 00000100:00100000:0.0:1789892676.107711:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543296 00000100:00100000:0.0:1789892676.107741:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2322 00000100:00100000:0.0:1789892676.107749:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217245:x1876835055543296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892676.107847:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217245:x1876835055543296:12345-0@lo:502:llog_process_th.0 Request processed in 98us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.107855:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2322 00000100:00100000:3.0:1789892676.107886:0:217245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217245:1876835055543296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.107931:0:217245:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217245:1876835055543424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.107981:0:217245:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.108012:0:217245:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892676.108017:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543424 00000100:00100000:2.0:1789892676.108021:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543424 00000100:00100000:2.0:1789892676.108046:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2323 00000100:00100000:2.0:1789892676.108051:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217245:x1876835055543424:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.108120:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217245:x1876835055543424:12345-0@lo:502:llog_process_th.0 Request processed in 68us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.108125:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2323 00000100:00100000:3.0:1789892676.108162:0:217245:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217245:1876835055543424:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892676.108186:0:217245:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789892676.108276:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789892676.108295:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892676.108301:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.108309:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892676.108316:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892676.108317:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:2.0:1789892676.108319:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892676.108335:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.108341:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.108347:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.108358:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.108380:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.108400:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031890cd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.108457:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543552 00000100:00100000:1.0:1789892676.108462:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543552 00000100:00100000:1.0:1789892676.108487:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2324 00000100:00100000:1.0:1789892676.108493:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055543552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892676.108501:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892676.108513:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af740 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.108531:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.108542:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.108550:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7000, rc 0) 00000100:00100000:1.0:1789892676.108585:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055543552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.108592:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2324 00000100:00100000:2.0:1789892676.108615:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.108627:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.108633:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.108674:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.108724:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.108745:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031890cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.108772:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543680 00000100:00100000:0.0:1789892676.108778:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543680 00000100:00100000:0.0:1789892676.108809:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2325 00000100:00100000:0.0:1789892676.108818:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055543680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.108904:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055543680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 86us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.108915:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2325 00000100:00100000:2.0:1789892676.108921:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.108946:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543808:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.108986:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.108999:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031890cd240 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.109028:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543808 00000100:00100000:0.0:1789892676.109034:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543808 00000100:00100000:0.0:1789892676.109063:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2326 00000100:00100000:0.0:1789892676.109071:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055543808:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.109156:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055543808:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 85us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.109165:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2326 00000100:00100000:2.0:1789892676.109180:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543808:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892676.109782:0:217246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:3.0:1789892676.109847:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:3.0:1789892676.109869:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789892676.109875:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.109885:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892676.109893:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892676.109895:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 180 10000000:01000000:3.0:1789892676.109898:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892676.109915:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.109922:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.109931:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.109946:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.109989:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.110012:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055543936 00000100:00100000:2.0:1789892676.110016:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055543936 00000100:00100000:3.0:1789892676.110020:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892676.110043:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2327 00000100:00100000:2.0:1789892676.110048:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055543936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.110054:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892676.110061:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af74e expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.110073:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.110085:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.110090:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383c00, rc 0) 00000100:00100000:2.0:1789892676.110117:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055543936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.110123:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2327 00000100:00100000:3.0:1789892676.110152:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055543936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892676.110165:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.110173:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.110223:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.110256:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.110275:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.110296:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544064 00000100:00100000:1.0:1789892676.110307:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544064 00000100:00100000:1.0:1789892676.110332:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2328 00000100:00100000:1.0:1789892676.110338:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055544064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.110398:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055544064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.110404:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2328 00000100:00100000:3.0:1789892676.110429:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.110455:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.110495:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.110515:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.110540:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544192 00000100:00100000:0.0:1789892676.110544:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544192 00000100:00100000:0.0:1789892676.110568:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2329 00000100:00100000:0.0:1789892676.110572:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055544192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.110633:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055544192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.110639:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2329 00000100:00100000:3.0:1789892676.110664:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.110893:0:217247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217247:1876835055544320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.110928:0:217247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.110969:0:217247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.110982:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544320 00000100:00100000:0.0:1789892676.110986:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544320 00000100:00100000:0.0:1789892676.111007:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2330 00000100:00100000:0.0:1789892676.111011:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217247:x1876835055544320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892676.111075:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217247:x1876835055544320:12345-0@lo:502:llog_process_th.0 Request processed in 62us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.111081:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2330 00000100:00100000:3.0:1789892676.111093:0:217247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217247:1876835055544320:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.111135:0:217247:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217247:1876835055544448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.111170:0:217247:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.111188:0:217247:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030913bdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892676.111200:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544448 00000100:00100000:2.0:1789892676.111204:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544448 00000100:00100000:2.0:1789892676.111227:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2331 00000100:00100000:2.0:1789892676.111231:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217247:x1876835055544448:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.111290:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217247:x1876835055544448:12345-0@lo:502:llog_process_th.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.111297:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2331 00000100:00100000:3.0:1789892676.111315:0:217247:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217247:1876835055544448:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892676.111339:0:217247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789892676.111383:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789892676.111400:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892676.111406:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.111412:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892676.111419:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892676.111420:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892676.111422:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892676.111433:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.111446:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.111452:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.111463:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.111483:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.111497:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.111528:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544576 00000100:00100000:1.0:1789892676.111534:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544576 00000100:00100000:1.0:1789892676.111561:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2332 00000100:00100000:1.0:1789892676.111566:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055544576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892676.111572:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892676.111580:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af75c expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.111593:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.111601:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.111606:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7800, rc 0) 00000100:00100000:1.0:1789892676.111634:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055544576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.111640:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2332 00000100:00100000:2.0:1789892676.111659:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.111670:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.111703:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.111747:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.111774:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.111796:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.111802:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544704 00000100:00100000:0.0:1789892676.111806:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544704 00000100:00100000:0.0:1789892676.111830:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2333 00000100:00100000:0.0:1789892676.111835:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055544704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.111897:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055544704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.111904:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.111905:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2333 00000100:00100000:2.0:1789892676.111933:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.111977:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.111989:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.112001:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544832 00000100:00100000:0.0:1789892676.112005:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544832 00000100:00100000:0.0:1789892676.112034:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2334 00000100:00100000:0.0:1789892676.112038:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055544832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.112098:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055544832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.112104:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2334 00000100:00100000:2.0:1789892676.112115:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892676.112665:0:217248:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:3.0:1789892676.112733:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:3.0:1789892676.112761:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789892676.112767:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.112788:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892676.112797:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892676.112799:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 180 10000000:01000000:3.0:1789892676.112801:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892676.112816:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.112824:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.112832:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.112846:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.112874:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.112894:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055544960 00000100:00100000:2.0:1789892676.112899:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055544960 00000100:00100000:3.0:1789892676.112903:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892676.112925:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2335 00000100:00100000:2.0:1789892676.112930:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055544960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.112936:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892676.112942:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af76a expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.112952:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.112970:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.112976:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382e00, rc 0) 00000100:00100000:2.0:1789892676.113003:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055544960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.113008:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2335 00000100:00100000:3.0:1789892676.113038:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055544960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892676.113051:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.113060:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.113097:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.113129:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.113155:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.113173:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545088 00000100:00100000:1.0:1789892676.113178:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545088 00000100:00100000:1.0:1789892676.113202:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2336 00000100:00100000:1.0:1789892676.113207:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055545088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.113274:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055545088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.113280:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2336 00000100:00100000:3.0:1789892676.113305:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.113334:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.113373:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.113393:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.113412:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545216 00000100:00100000:0.0:1789892676.113417:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545216 00000100:00100000:0.0:1789892676.113443:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2337 00000100:00100000:0.0:1789892676.113449:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055545216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.113509:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055545216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.113515:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2337 00000100:00100000:3.0:1789892676.113541:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.113826:0:217249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217249:1876835055545344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.113854:0:217249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.113875:0:217249:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.113885:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545344 00000100:00100000:0.0:1789892676.113890:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545344 00000100:00100000:0.0:1789892676.113912:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2338 00000100:00100000:0.0:1789892676.113917:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217249:x1876835055545344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892676.113994:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217249:x1876835055545344:12345-0@lo:502:llog_process_th.0 Request processed in 76us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.114000:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2338 00000100:00100000:3.0:1789892676.114009:0:217249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217249:1876835055545344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.114040:0:217249:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217249:1876835055545472:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.114067:0:217249:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.114081:0:217249:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789892676.114095:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545472 00000100:00100000:2.0:1789892676.114099:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545472 00000100:00100000:2.0:1789892676.114121:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2339 00000100:00100000:2.0:1789892676.114127:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217249:x1876835055545472:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.114186:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217249:x1876835055545472:12345-0@lo:502:llog_process_th.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.114193:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2339 00000100:00100000:3.0:1789892676.114202:0:217249:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217249:1876835055545472:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892676.114224:0:217249:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789892676.114258:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789892676.114277:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892676.114283:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.114295:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892676.114302:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892676.114304:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 206 10000000:01000000:2.0:1789892676.114306:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892676.114322:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.114330:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.114339:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.114353:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.114382:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.114403:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.114455:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545600 00000100:00100000:1.0:1789892676.114461:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545600 00000100:00100000:1.0:1789892676.114485:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2340 00000100:00100000:1.0:1789892676.114491:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055545600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892676.114497:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892676.114506:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af778 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.114519:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.114526:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.114532:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7200, rc 0) 00000100:00100000:1.0:1789892676.114560:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055545600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 70us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.114566:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2340 00000100:00100000:2.0:1789892676.114586:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.114598:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.114605:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.114638:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.114666:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892676.114721:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545728 00000100:00100000:2.0:1789892676.114726:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.114727:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545728 00000100:00100000:0.0:1789892676.114761:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2341 00000100:00100000:0.0:1789892676.114770:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055545728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.114848:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055545728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 78us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892676.114852:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.114864:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2341 00000100:00100000:2.0:1789892676.114878:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.114911:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.114923:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.114940:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545856 00000100:00100000:0.0:1789892676.114946:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545856 00000100:00100000:0.0:1789892676.114986:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2342 00000100:00100000:0.0:1789892676.114995:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055545856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.115074:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055545856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.115083:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2342 00000100:00100000:2.0:1789892676.115093:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055545856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.115300:0:217250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217250:1876835055545984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.115338:0:217250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.115359:0:217250:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.115395:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055545984 00000100:00100000:1.0:1789892676.115401:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055545984 00000100:00100000:1.0:1789892676.115431:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2343 00000100:00100000:1.0:1789892676.115437:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217250:x1876835055545984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892676.115517:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217250:x1876835055545984:12345-0@lo:502:llog_process_th.0 Request processed in 79us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.115531:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2343 00000100:00100000:2.0:1789892676.115538:0:217250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217250:1876835055545984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892676.115568:0:217250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892676.115581:0:217250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892676.115584:0:217250:0:(obd_config.c:1561:class_process_config()) marker 194 (0x1) lustre-MDT0001-m del lustre.qpool1 00000020:00000080:2.0:1789892676.115592:0:217250:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1789892676.115707:0:217250:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217250:1876835055546112:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.115747:0:217250:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.115770:0:217250:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.115795:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546112 00000100:00100000:1.0:1789892676.115801:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546112 00000100:00100000:1.0:1789892676.115828:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2344 00000100:00100000:1.0:1789892676.115835:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217250:x1876835055546112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892676.115904:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217250:x1876835055546112:12345-0@lo:502:llog_process_th.0 Request processed in 68us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.115912:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2344 00000100:00100000:2.0:1789892676.115924:0:217250:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217250:1876835055546112:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892676.115949:0:217250:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892676.115967:0:217250:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892676.115969:0:217250:0:(obd_config.c:1561:class_process_config()) marker 194 (0x2) lustre-MDT0001-m del lustre.qpool1 00000040:00080000:2.0:1789892676.115975:0:217250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 209 count 205 00000020:01000000:3.0:1789892676.116034:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 206-208 (rc=0) 10000000:01000000:3.0:1789892676.116055:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789892676.116061:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.116071:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892676.116079:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892676.116082:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 180 10000000:01000000:3.0:1789892676.116090:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892676.116104:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.116111:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.116118:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.116131:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.116156:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.116174:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.116201:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546240 00000100:00100000:0.0:1789892676.116207:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546240 00000100:00100000:0.0:1789892676.116234:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2345 00000100:00100000:0.0:1789892676.116240:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055546240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892676.116249:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892676.116260:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af786 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892676.116276:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892676.116285:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 22 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892676.116293:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99c00, rc 0) 00000100:00100000:0.0:1789892676.116329:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055546240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.116336:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2345 00000100:00100000:3.0:1789892676.116357:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892676.116371:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.116382:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.116418:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.116444:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.116461:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.116485:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546368 00000100:00100000:0.0:1789892676.116491:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546368 00000100:00100000:0.0:1789892676.116517:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2346 00000100:00100000:0.0:1789892676.116525:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055546368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892676.116604:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055546368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 79us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.116614:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2346 00000100:00100000:3.0:1789892676.116625:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.116648:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.116676:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.116713:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185513d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.116727:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546496 00000100:00100000:1.0:1789892676.116733:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546496 00000100:00100000:1.0:1789892676.116762:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2347 00000100:00100000:1.0:1789892676.116770:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055546496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.116841:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055546496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.116850:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2347 00000100:00100000:3.0:1789892676.116862:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.117079:0:217251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217251:1876835055546624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.117106:0:217251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.117123:0:217251:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.117149:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546624 00000100:00100000:1.0:1789892676.117154:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546624 00000100:00100000:1.0:1789892676.117179:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2348 00000100:00100000:1.0:1789892676.117185:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217251:x1876835055546624:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892676.117275:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217251:x1876835055546624:12345-0@lo:502:llog_process_th.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.117287:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2348 00000100:00100000:3.0:1789892676.117295:0:217251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217251:1876835055546624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.117339:0:217251:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217251:1876835055546752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892676.117374:0:217251:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.117395:0:217251:0:(client.c:2702:ptlrpc_set_wait()) set ffff903181254780 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.117406:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546752 00000100:00100000:0.0:1789892676.117411:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546752 00000100:00100000:0.0:1789892676.117439:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2349 00000100:00100000:0.0:1789892676.117446:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217251:x1876835055546752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892676.117520:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217251:x1876835055546752:12345-0@lo:502:llog_process_th.0 Request processed in 73us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892676.117529:0:217251:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217251:1876835055546752:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892676.117531:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2349 00000040:00080000:3.0:1789892676.117551:0:217251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000020:01000000:2.0:1789892676.117610:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 180-183 (rc=0) 10000000:01000000:2.0:1789892676.117628:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892676.117634:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.117656:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892676.117664:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892676.117666:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 206 10000000:01000000:2.0:1789892676.117669:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892676.117709:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.117719:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.117729:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.117745:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.117774:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.117805:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.117813:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055546880 00000100:00100000:0.0:1789892676.117819:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055546880 00000100:00100000:0.0:1789892676.117848:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2350 00000100:00100000:0.0:1789892676.117856:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055546880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892676.117864:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892676.117873:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af794 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892676.117888:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892676.117898:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892676.117906:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98e00, rc 0) 00000100:00100000:0.0:1789892676.117939:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055546880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.117971:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2350 00000100:00100000:2.0:1789892676.117981:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055546880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892676.117995:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892676.118005:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892676.118047:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.118075:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.118102:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.118120:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547008 00000100:00100000:1.0:1789892676.118125:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547008 00000100:00100000:1.0:1789892676.118147:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2351 00000100:00100000:1.0:1789892676.118153:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055547008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.118222:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055547008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 69us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.118228:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2351 00000100:00100000:2.0:1789892676.118255:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.118284:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.118321:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.118341:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.118371:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547136 00000100:00100000:1.0:1789892676.118376:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547136 00000100:00100000:1.0:1789892676.118399:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2352 00000100:00100000:1.0:1789892676.118404:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055547136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.118468:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055547136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 63us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.118473:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2352 00000100:00100000:2.0:1789892676.118499:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892676.118839:0:217252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217252:1876835055547264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.118875:0:217252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.118901:0:217252:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892676.118921:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547264 00000100:00100000:0.0:1789892676.118927:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547264 00000100:00100000:0.0:1789892676.118967:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2353 00000100:00100000:0.0:1789892676.118975:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217252:x1876835055547264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892676.119065:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217252:x1876835055547264:12345-0@lo:502:llog_process_th.0 Request processed in 90us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892676.119074:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2353 00000100:00100000:2.0:1789892676.119082:0:217252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217252:1876835055547264:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892676.119112:0:217252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892676.119120:0:217252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892676.119121:0:217252:0:(obd_config.c:1561:class_process_config()) marker 193 (0x1) lustre-MDT0000-m del lustre.qpool1 00000020:00000080:2.0:1789892676.119128:0:217252:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:2.0:1789892676.120452:0:217252:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217252:1876835055547392:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892676.120497:0:217252:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892676.120543:0:217252:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081632b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.120553:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547392 00000100:00100000:1.0:1789892676.120560:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547392 00000100:00100000:1.0:1789892676.120591:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2354 00000100:00100000:1.0:1789892676.120599:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217252:x1876835055547392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892676.120666:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217252:x1876835055547392:12345-0@lo:502:llog_process_th.0 Request processed in 69us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.120672:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2354 00000100:00100000:2.0:1789892676.120722:0:217252:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217252:1876835055547392:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892676.120748:0:217252:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892676.120753:0:217252:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892676.120755:0:217252:0:(obd_config.c:1561:class_process_config()) marker 193 (0x2) lustre-MDT0000-m del lustre.qpool1 00000040:00080000:2.0:1789892676.120761:0:217252:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 209 count 205 00000020:01000000:3.0:1789892676.120810:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 206-208 (rc=0) 10000000:01000000:3.0:1789892676.120831:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892676.120836:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.120844:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892676.120850:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892676.120852:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892676.120854:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892676.120866:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.120871:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.120885:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.120895:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.120917:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.120939:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.120949:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547520 00000100:00100000:1.0:1789892676.120964:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547520 00000100:00100000:1.0:1789892676.120986:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2355 00000100:00100000:1.0:1789892676.120990:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055547520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892676.120996:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892676.121004:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af7a2 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.121016:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.121030:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 24 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892676.121036:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6800, rc 0) 00000100:00100000:1.0:1789892676.121062:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055547520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.121067:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2355 00000100:00100000:3.0:1789892676.121089:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892676.121098:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.121104:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892676.121132:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892676.121151:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892676.121165:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031855136c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892676.121180:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547648 00000100:00100000:1.0:1789892676.121184:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547648 00000100:00100000:1.0:1789892676.121204:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2356 00000100:00100000:1.0:1789892676.121208:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055547648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892676.121253:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055547648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 43us (100us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892676.121258:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2356 00000100:00100000:3.0:1789892676.121268:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055547648:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892676.121287:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892676.121291:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892676.121296:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892676.625868:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789892676.625894:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055547776:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892676.625988:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892676.626044:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547776 00000100:00100000:1.0:1789892676.626055:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547776 00000100:00100000:1.0:1789892676.626118:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789892676.626131:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055547776:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892676.626176:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892676.626240:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055547776:12345-0@lo:41:osp-pre-1-0.0 Request processed in 111us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892676.626250:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:0.0:1789892676.626294:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055547776:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892676.689853:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892677.137847:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031916ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055547904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892677.137847:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055548032:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789892677.137977:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.137993:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055548160:0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.138021:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055548288:0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.138044:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.138060:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055548544:0@lo:400:kworker.0 00000100:00100000:0.0:1789892677.138093:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548160 00000100:00100000:0.0:1789892677.138104:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548160 00000100:00100000:2.0:1789892677.138108:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876835055548672:0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.138118:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.138130:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.138165:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892677.138179:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055548800:0@lo:400:kworker.0 00000100:00100000:0.0:1789892677.138180:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2357 00000100:00100000:1.0:1789892677.138183:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055549056:0@lo:400:kworker.0 00000100:00100000:0.0:1789892677.138200:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055548160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.138203:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055549184:0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.138241:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.138261:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.138272:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892677.138284:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876835055549312:0@lo:400:kworker.0 00000100:00100000:0.0:1789892677.138296:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055548160:12345-0@lo:400:kworker.0 Request processed in 98us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892677.138308:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2357 00000100:00100000:1.0:1789892677.138310:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876835055549568:0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.138326:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876835055549696:0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.138339:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.138367:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548032 00000100:00100000:1.0:1789892677.138375:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548032 00000100:00100000:2.0:1789892677.138396:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892677.138435:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548288 00000100:00100000:3.0:1789892677.138442:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548288 00000100:00100000:1.0:1789892677.138445:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789892677.138456:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055548160:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.138463:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055548032:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892677.138504:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548800 00002000:00000024:1.0:1789892677.138507:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892677.138509:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548800 00000100:00100000:2.0:1789892677.138513:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548672 00000100:00100000:2.0:1789892677.138522:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548672 00000100:00100000:3.0:1789892677.138534:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1789892677.138545:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055548288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.138571:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055548032:12345-0@lo:13:osp-pre-0-1.0 Request processed in 113us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.138573:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549184 00000100:00100000:2.0:1789892677.138580:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549184 00000100:00100000:1.0:1789892677.138587:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789892677.138614:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055548288:12345-0@lo:400:kworker.0 Request processed in 68us (505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892677.138625:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789892677.138632:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549312 00000100:00100000:2.0:1789892677.138638:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549312 00000100:00100000:1.0:1789892677.138646:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789892677.138665:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055548800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.138675:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549696 00000100:00100000:3.0:1789892677.138733:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497 00000100:00100000:3.0:1789892677.138745:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876835055548672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.138751:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549696 00000100:00100000:1.0:1789892677.138767:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055548800:12345-0@lo:400:kworker.0 Request processed in 107us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.138782:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1789892677.138787:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 498 00000100:00100000:2.0:1789892677.138800:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876835055549184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.138806:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876835055548672:12345-0@lo:400:kworker.0 Request processed in 64us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892677.138815:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497 00000100:00100000:1.0:1789892677.138835:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548544 00000100:00100000:3.0:1789892677.138841:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499 00000100:00100000:1.0:1789892677.138843:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548544 00000100:00100000:3.0:1789892677.138854:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876835055549312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.138864:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876835055549184:12345-0@lo:400:kworker.0 Request processed in 66us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.138875:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 498 00000100:00100000:3.0:1789892677.138907:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876835055549312:12345-0@lo:400:kworker.0 Request processed in 53us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.138907:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549056 00000100:00100000:2.0:1789892677.138917:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00000100:00100000:1.0:1789892677.138919:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549056 00000100:00100000:3.0:1789892677.138932:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499 00000100:00100000:2.0:1789892677.138938:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876835055549696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.138977:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.138994:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789892677.139010:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055548544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.139015:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031916b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876835055549696:12345-0@lo:400:kworker.0 Request processed in 79us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.139025:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:3.0:1789892677.139030:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.139098:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055548544:12345-0@lo:400:kworker.0 Request processed in 85us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892677.139109:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.139117:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00010000:00080000:2.0:1789892677.139131:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90308b74a680 x1876835055549696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892677.139148:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548416 00000100:00100000:1.0:1789892677.139155:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548416 00000100:00100000:3.0:1789892677.139156:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055548928:0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.139157:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876835055549696:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.139194:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789892677.139200:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876835055548672:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.139208:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055549056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.139217:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.139220:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055549184:0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.139242:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876835055549440:0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.139250:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789892677.139263:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055549824:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892677.139278:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c67100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055549056:12345-0@lo:400:kworker.0 Request processed in 73us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892677.139285:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.139298:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892677.139304:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789892677.139323:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055549952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892677.139332:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055548928 00000100:00100000:1.0:1789892677.139339:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055548928 00000100:00100000:2.0:1789892677.139356:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055547904 00000100:00100000:3.0:1789892677.139362:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.139365:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055547904 00000100:00100000:1.0:1789892677.139371:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789892677.139388:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055548416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.139416:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549824 00000100:00100000:2.0:1789892677.139420:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549824 00000100:00100000:3.0:1789892677.139434:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789892677.139447:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308b74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055547904:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892677.139456:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789892677.139467:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055548416:12345-0@lo:400:kworker.0 Request processed in 85us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.139468:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055549824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789892677.139472:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892677.139494:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00002000:00000024:2.0:1789892677.139500:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892677.139529:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789892677.139549:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308b74aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055547904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.139551:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055548928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.139572:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789892677.139574:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055549824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.139587:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789892677.139614:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549952 00000100:00100000:3.0:1789892677.139620:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549952 00000100:00100000:1.0:1789892677.139622:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082132a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055548928:12345-0@lo:400:kworker.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.139634:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1789892677.139660:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055549824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892677.139670:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789892677.139712:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055549952:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:1.0:1789892677.139724:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789892677.139735:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1789892677.139739:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00080000:1.0:1789892677.139741:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892677.139746:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055548288:0@lo:400:kworker.0 00000100:00080000:1.0:1789892677.139756:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892677.139777:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055548800:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.139800:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549440 00000100:00100000:1.0:1789892677.139809:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549440 00000100:00100000:2.0:1789892677.139820:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876835055549312:0@lo:400:kworker.0 00000100:00100000:3.0:1789892677.139821:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055549952:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892677.139840:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789892677.139865:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:1.0:1789892677.139879:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876835055549440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.139940:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876835055549440:12345-0@lo:400:kworker.0 Request processed in 62us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.139973:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319ee2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055549952:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892677.139982:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:3.0:1789892677.139989:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892677.140007:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055548416:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.140032:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055549568 00000100:00100000:1.0:1789892677.140039:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055549568 00000100:00100000:2.0:1789892677.140047:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055548928:0@lo:400:kworker.0 00010000:00080000:2.0:1789892677.140066:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90308b748000 x1876835055549440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892693 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892677.140073:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055548032:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892677.140083:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876835055549440:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.140086:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:1.0:1789892677.140098:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876835055549568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892677.140115:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031916ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055547904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892677.140146:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309210f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055548544:0@lo:400:kworker.0 00000100:00100000:1.0:1789892677.140161:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082130700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876835055549568:12345-0@lo:400:kworker.0 Request processed in 61us (181us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.140172:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:3.0:1789892677.140179:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055549056:0@lo:400:kworker.0 00000100:00080000:1.0:1789892677.140199:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892677.140210:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308b74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876835055549568:0@lo:400:kworker.0 00000100:00080000:1.0:1789892677.140210:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892677.691826:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892677.691931:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745472 00000100:00100000:0.0:1789892677.691955:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745472 00000100:00100000:0.0:1789892677.692022:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2358 00000100:00100000:0.0:1789892677.692032:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062745472:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892677.692054:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892677.692095:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260401 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892677.692127:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892677.692138:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892677.692147:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98c00, rc 0) 00000100:00100000:0.0:1789892677.692210:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062745472:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 180us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892677.692216:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2358 00000100:00100000:0.0:1789892677.693141:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892677.693185:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745600 00000100:00100000:2.0:1789892677.693189:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745600 00000100:00100000:2.0:1789892677.693219:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2359 00000100:00100000:2.0:1789892677.693224:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062745600:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892677.693356:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062745600:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 131us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.693362:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2359 00000100:00100000:3.0:1789892677.694087:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892677.694173:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745728 00000100:00100000:1.0:1789892677.694181:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745728 00000100:00100000:1.0:1789892677.694223:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2360 00000100:00100000:1.0:1789892677.694235:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062745728:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892677.694360:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062745728:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 128us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.694369:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2360 00000100:00100000:3.0:1789892677.695431:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892677.695470:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745856 00000100:00100000:1.0:1789892677.695475:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745856 00000100:00100000:1.0:1789892677.695509:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2361 00000100:00100000:1.0:1789892677.695518:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216184:x1876835062745856:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892677.695618:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216184:x1876835062745856:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 100us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.695628:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2361 00000100:00100000:0.0:1789892677.696395:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892677.696440:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062745984 00000100:00100000:1.0:1789892677.696451:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062745984 00000100:00100000:1.0:1789892677.696477:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2362 00000100:00100000:1.0:1789892677.696483:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216184:x1876835062745984:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892677.696541:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216184:x1876835062745984:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 57us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892677.696547:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2362 00000100:00100000:3.0:1789892677.697518:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892677.697587:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746112 00000100:00100000:2.0:1789892677.697592:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746112 00000100:00100000:2.0:1789892677.697626:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2363 00000100:00100000:2.0:1789892677.697649:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062746112:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892677.697659:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892677.697670:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260408 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892677.697712:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892677.697719:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892677.697732:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383000, rc 0) 00000100:00100000:2.0:1789892677.697759:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062746112:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 116us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892677.697764:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2363 00000100:00100000:3.0:1789892677.698360:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892677.698406:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746240 00000100:00100000:1.0:1789892677.698411:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746240 00000100:00100000:1.0:1789892677.698438:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2364 00000100:00100000:1.0:1789892677.698445:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062746240:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892677.698493:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062746240:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 49us (134us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892677.698498:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2364 00010000:00010000:3.0:1789892677.713831:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892678.674864:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055550080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892678.674975:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892678.675020:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055550080 00000100:00100000:0.0:1789892678.675029:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055550080 00000100:00100000:0.0:1789892678.675081:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789892678.675090:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055550080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789892678.675115:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892678.675167:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055550080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892678.675173:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789892678.675224:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055550080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789892678.737818:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892679.272849:0:217445:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffd8633b2e0 20000000:00000080:1.0:1789892679.272866:0:217445:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90309214dc00 uarg=0000000000000000 00000040:00100000:1.0:1789892679.273391:0:217445:0:(llog.c:1072:llog_reverse_process()) index 183 : idx 181 00000040:00100000:1.0:1789892679.273399:0:217445:0:(llog.c:1072:llog_reverse_process()) index 179 : idx 137 20000000:01000000:1.0:1789892679.273403:0:217445:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 172 cmd:0xce021 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:1.0:1789892679.273416:0:217445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1789892679.273733:0:217446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 171 marker 183 1->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:3.0:1789892679.273787:0:217446:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 173 marker 183 2->4: lustre-clilov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789892679.273801:0:217446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 184 count 180 00000040:00080000:1.0:1789892679.273928:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].184, 224 off41736 20000000:01000000:1.0:1789892679.273956:0:217445:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892679.273970:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].185, 128 off41864 00000040:00080000:1.0:1789892679.273981:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].186, 224 off42088 20000000:01000000:1.0:1789892679.273990:0:217445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1789892679.274207:0:217447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 197 marker 184 1->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:3.0:1789892679.274225:0:217447:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 199 marker 184 2->4: lustre-MDT0000-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789892679.274235:0:217447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 209 count 205 00000040:00080000:1.0:1789892679.274307:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].209, 224 off46544 20000000:01000000:1.0:1789892679.274315:0:217445:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892679.274325:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].210, 136 off46680 00000040:00080000:1.0:1789892679.274343:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].211, 224 off46904 20000000:01000000:1.0:1789892679.274351:0:217445:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/add lustre.qpool2.lustre-OST0001_UUID fl=4 20000000:01000000:3.0:1789892679.274568:0:217448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 197 marker 185 1->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 20000000:01000000:3.0:1789892679.274586:0:217448:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 199 marker 185 2->4: lustre-MDT0001-mdtlov add lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789892679.274600:0:217448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 209 count 205 00000040:00080000:1.0:1789892679.274667:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].209, 224 off46544 20000000:01000000:1.0:1789892679.274675:0:217445:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce022 lustre qpool2 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892679.274769:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].210, 136 off46680 00000040:00080000:1.0:1789892679.274784:0:217445:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].211, 224 off46904 10000000:01000000:1.0:1789892679.274795:0:217445:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892679.274817:0:217445:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274836:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274843:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274848:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274853:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274857:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274862:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274866:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274880:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274885:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274892:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274897:0:217445:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274902:0:217445:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274961:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.274976:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 9 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.274990:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550208:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892679.275100:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275111:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 9 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.275124:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550336:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892679.275174:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275184:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 23 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.275197:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550464:0@lo:104: 00000100:00100000:1.0:1789892679.275246:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892679.275277:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275283:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 23 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.275290:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550592:0@lo:104: 00000100:00100000:1.0:1789892679.275307:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892679.275320:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055550464 00000100:00100000:3.0:1789892679.275328:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055550464 00010000:00010000:1.0:1789892679.275337:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275349:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 23 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.275353:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055550592 00000100:00100000:1.0:1789892679.275358:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550720:0@lo:104: 00000100:00100000:2.0:1789892679.275359:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055550592 00000100:00100000:1.0:1789892679.275384:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892679.275406:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055550720 00000100:00100000:2.0:1789892679.275410:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055550720 00000100:00100000:3.0:1789892679.275429:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500 00010000:00010000:1.0:1789892679.275436:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275452:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 23 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.275458:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550592:12345-0@lo:104: 00000100:00100000:0.0:1789892679.275458:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1789892679.275472:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502 00000100:00100000:0.0:1789892679.275483:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550464:12345-0@lo:104: 00000100:00100000:2.0:1789892679.275494:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550720:12345-0@lo:104: 00000100:00100000:1.0:1789892679.275498:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550848:0@lo:104: 00010000:00010000:3.0:1789892679.275522:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.275524:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.275529:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.275544:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892679.275569:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275583:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 23 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.275595:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789892679.275609:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550720:12345-0@lo:104: Request processed in 120us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892679.275616:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550976:0@lo:104: 00000100:00100000:2.0:1789892679.275618:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502 00000100:00100000:2.0:1789892679.275648:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892679.275651:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.275662:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 23 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.275675:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551104:0@lo:104: 00000100:00100000:2.0:1789892679.275732:0:194861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892679.275754:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892679.275755:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055550848 00000100:00100000:2.0:1789892679.275763:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055550848 00000100:00100000:1.0:1789892679.275767:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892679.275772:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550464:12345-0@lo:104: Request processed in 291us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.275784:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501 00000100:00100000:2.0:1789892679.275792:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055550976 00000100:00100000:2.0:1789892679.275799:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055550976 00010000:00010000:3.0:1789892679.275820:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789892679.275826:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551104 00010000:00010000:1.0:1789892679.275832:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.275837:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550592:12345-0@lo:104: Request processed in 391us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.275837:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 503 00000100:00100000:0.0:1789892679.275839:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551104 00010000:00010000:1.0:1789892679.275848:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 23 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.275858:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500 00000100:00100000:2.0:1789892679.275858:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903093cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:217445:x1876835055550848:12345-0@lo:104: 00000100:00100000:1.0:1789892679.275861:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551232:0@lo:104: 00010000:00010000:2.0:1789892679.275873:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.275884:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 504 00000100:00100000:3.0:1789892679.275903:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1789892679.275908:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550976:12345-0@lo:104: 00000100:00100000:1.0:1789892679.275916:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892679.275923:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055551104:12345-0@lo:104: 00010000:00010000:0.0:1789892679.275924:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.275951:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.275955:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789892679.275959:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.275966:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903093cd3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217445:x1876835055550848:12345-0@lo:104: Request processed in 114us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.275975:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 503 00010000:00010000:1.0:1789892679.275985:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 23 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.276001:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd38000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551360:0@lo:104: 00010000:00010000:0.0:1789892679.276015:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789892679.276016:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:3.0:1789892679.276040:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217445:x1876835055551104:12345-0@lo:104: Request processed in 113us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.276044:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217445:x1876835055550976:12345-0@lo:104: Request processed in 136us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.276046:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551232 00000100:00100000:1.0:1789892679.276051:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892679.276057:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551232 00000100:00100000:3.0:1789892679.276069:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00000100:00100000:0.0:1789892679.276082:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 504 00010000:00010000:1.0:1789892679.276089:0:217445:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.276096:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551360 00000100:00100000:3.0:1789892679.276101:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551360 00010000:00010000:1.0:1789892679.276105:0:217445:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 23 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.276108:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1789892679.276119:0:217445:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551488:0@lo:104: 00000100:00100000:2.0:1789892679.276126:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217445:x1876835055551232:12345-0@lo:104: 00000100:00100000:0.0:1789892679.276135:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00010000:00010000:2.0:1789892679.276136:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.276151:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217445:x1876835055551360:12345-0@lo:104: 00000100:00100000:1.0:1789892679.276168:0:217445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892679.276174:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276178:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789892679.276182:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789892679.276191:0:217445:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892679.276195:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217445:x1876835055551232:12345-0@lo:104: Request processed in 77us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.276205:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00010000:00010000:0.0:1789892679.276222:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789892679.276224:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c66300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550464:0@lo:104: 00000100:00100000:2.0:1789892679.276232:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551488 00000100:00100000:0.0:1789892679.276234:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217445:x1876835055551360:12345-0@lo:104: Request processed in 86us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.276239:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551488 00000100:00100000:0.0:1789892679.276245:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:1.0:1789892679.276252:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550592:0@lo:104: 00000100:00100000:1.0:1789892679.276274:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550720:0@lo:104: 00010000:00010000:3.0:1789892679.276280:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.276291:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd39180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550848:0@lo:104: 00010000:00010000:3.0:1789892679.276293:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:0.0:1789892679.276301:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:1.0:1789892679.276303:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550976:0@lo:104: 10000000:00010000:3.0:1789892679.276305:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276318:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.276318:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217445:x1876835055551488:12345-0@lo:104: 00010000:00010000:2.0:1789892679.276319:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00000100:00100000:1.0:1789892679.276320:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551104:0@lo:104: 00010000:00010000:2.0:1789892679.276327:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.276335:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551232:0@lo:104: 10000000:00010000:3.0:1789892679.276354:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276355:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892679.276360:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.276361:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd38000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551360:0@lo:104: 00010000:00010000:0.0:1789892679.276363:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276398:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789892679.276403:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276404:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276427:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383400 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892679.276428:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892679.276431:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892679.276437:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892679.276438:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:1.0:1789892679.276440:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892679.276452:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892679.276457:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217445:x1876835055551488:12345-0@lo:104: Request processed in 142us (297us total) trans 0 rc 0/0 10000000:00010000:1.0:1789892679.276470:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.276476:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00010000:00010000:2.0:1789892679.276478:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276480:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892679.276491:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892679.276502:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892679.276503:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892679.276515:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276517:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276521:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789892679.276525:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892679.276526:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276531:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c600/0xd5b980e0d62af7a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7a9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276540:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276544:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276551:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af786 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af78d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276569:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789892679.276579:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276594:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af794 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af79b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276595:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892679.276599:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9cc00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892679.276600:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:00010000:2.0:1789892679.276608:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276613:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892679.276614:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276615:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892679.276618:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276621:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892679.276651:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276657:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892679.276665:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276666:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892679.276674:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892679.276700:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892679.276706:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276715:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892679.276717:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276729:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892679.276750:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892679.276757:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276765:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789892679.276767:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276776:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892679.276776:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789892679.276792:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276794:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276797:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892679.276804:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9cc00/0xd5b980e0d62af76a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af771 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892679.276804:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892679.276817:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276819:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892679.276820:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276833:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276833:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276853:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382600/0xd5b980e0d62af75c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af763 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276864:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892679.276876:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382a00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892679.276876:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789892679.276884:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276884:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276885:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892679.276887:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276898:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.276930:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276930:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d000/0xd5b980e0d62af74e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af755 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.276946:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af778 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af77f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.276948:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:3.0:1789892679.276954:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892679.276963:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.276967:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892679.276971:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892679.276975:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892679.276984:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892679.276996:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892679.277006:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789892679.277013:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.277015:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd39880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055551488:0@lo:104: 00010000:00010000:0.0:1789892679.277020:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892679.277027:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789892679.277029:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892679.277031:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.277038:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892679.277040:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892679.277049:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.277057:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.277066:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892679.277073:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.277076:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382a00/0xd5b980e0d62af740 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af747 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.277081:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af732 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af739 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.277097:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892679.277103:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892679.277107:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055552128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.277107:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055552000:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892679.277109:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892679.277112:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892679.277117:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892679.277127:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892679.277154:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055551744:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892679.277188:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892679.277216:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055551872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.277224:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552128 00000100:00100000:0.0:1789892679.277229:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552128 00000100:00100000:2.0:1789892679.277254:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892679.277254:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055552640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892679.277256:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 24 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.277295:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055552384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892679.277307:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892679.277307:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551872 00000100:00100000:0.0:1789892679.277316:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551872 00010000:00010000:0.0:1789892679.277334:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 25 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.277339:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746368 00000100:00100000:1.0:1789892679.277341:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550208:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892679.277348:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746368 00000100:00100000:1.0:1789892679.277366:0:217445:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217445:1876835055550336:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892679.277376:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 554 00010000:00010000:2.0:1789892679.277383:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 10 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.277393:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892679.277404:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3621:x1876835055552128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892679.277415:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892679.277420:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746496 00010000:00010000:0.0:1789892679.277423:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 25 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.277427:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746496 00000100:00100000:3.0:1789892679.277437:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 555 00010000:00010000:0.0:1789892679.277444:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 25 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.277452:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 11 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.277453:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3619:x1876835055551872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892679.277475:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892679.277486:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 25 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.277493:0:217445:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.277501:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 556 00010000:00010000:3.0:1789892679.277508:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 25 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.277508:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7800/0xd5b980e0d62af763 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af75c expref: 25 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.277517:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062746368:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892679.277536:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892679.277548:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 11 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.277551:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98e00/0xd5b980e0d62af79b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af794 expref: 24 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.277561:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892679.277581:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892679.277585:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 11 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.277588:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 557 00000100:00100000:1.0:1789892679.277599:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062746496:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892679.277602:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af7b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260401 expref: 11 pid: 190664 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.277610:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892679.277616:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 10 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.277620:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892679.277628:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 10 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.277642:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3621:x1876835055552128:12345-0@lo:103:ldlm_bl.0 Request processed in 241us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892679.277645:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c67800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3619:x1876835055551872:12345-0@lo:103:ldlm_bl.0 Request processed in 195us (388us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892679.277646:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383000/0xd5b980e0d62af7b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260408 expref: 10 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892679.277666:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2396:x1876835062746368:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 149us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892679.277729:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 555 00010000:00010000:1.0:1789892679.277746:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892679.277759:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 554 00000100:00100000:3.0:1789892679.277769:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892679.277770:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 556 00000100:00100000:1.0:1789892679.277775:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062746496:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 177us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.277787:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552640 00000100:00100000:1.0:1789892679.277791:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 557 00000100:00100000:0.0:1789892679.277793:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552640 00010000:00010000:0.0:1789892679.277822:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 22 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.277835:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892679.277845:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055552128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.277861:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552000 00000100:00100000:0.0:1789892679.277867:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552000 00010000:00010000:0.0:1789892679.277882:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 23 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.277884:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 558 00000100:00100000:1.0:1789892679.277891:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055552512:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892679.277906:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3621:x1876835055552640:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892679.277924:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892679.277925:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892679.277956:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 23 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.277959:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551744 00000100:00100000:1.0:1789892679.277960:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892679.277968:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055551616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.277970:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551744 00010000:00010000:0.0:1789892679.278000:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 24 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.278012:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 24 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.278013:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552512 00000100:00100000:2.0:1789892679.278019:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892679.278023:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552512 00000100:00100000:2.0:1789892679.278045:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055552256:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892679.278048:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382000/0xd5b980e0d62af739 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af732 expref: 25 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.278049:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055551616 00010000:00010000:1.0:1789892679.278056:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 25 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.278058:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055551616 00010000:00010000:3.0:1789892679.278075:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892679.278076:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892679.278083:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 25 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.278088:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552256 00000100:00100000:1.0:1789892679.278102:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552256 00000100:00100000:0.0:1789892679.278115:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 559 00000100:00100000:3.0:1789892679.278131:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3621:x1876835055552640:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (361us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892679.278131:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 26 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.278135:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3620:x1876835055552000:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892679.278145:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 560 00000100:00100000:3.0:1789892679.278167:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 558 00010000:00010000:0.0:1789892679.278168:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892679.278170:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3618:x1876835055551744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892679.278182:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 26 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892679.278193:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892679.278200:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 25 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892679.278201:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 561 00010000:00010000:2.0:1789892679.278204:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 25 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.278222:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 562 00000100:00100000:1.0:1789892679.278224:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055552512:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892679.278243:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055551616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892679.278246:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892679.278262:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 25 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.278267:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892679.278276:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 25 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.278277:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 25 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278306:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62af771 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af76a expref: 25 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.278308:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 25 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.278338:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 24 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278353:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892679.278354:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62af78d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af786 expref: 24 pid: 190663 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.278360:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af747 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af740 expref: 24 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892679.278365:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af7a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af7a2 expref: 24 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.278384:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892679.278395:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892679.278397:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892679.278408:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3620:x1876835055552000:12345-0@lo:103:ldlm_bl.0 Request processed in 284us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.278417:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 559 00000100:00100000:1.0:1789892679.278453:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055552512:12345-0@lo:103:ldlm_bl.0 Request processed in 231us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.278453:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 563 00000100:00100000:3.0:1789892679.278462:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055551616:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.278464:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055551744:12345-0@lo:103:ldlm_bl.0 Request processed in 301us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.278474:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3618:x1876835055552256:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892679.278485:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 561 00000100:00100000:3.0:1789892679.278499:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 562 00010000:00010000:0.0:1789892679.278501:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892679.278507:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 560 00010000:00010000:0.0:1789892679.278510:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 19 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278525:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 17 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278543:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7200/0xd5b980e0d62af77f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af778 expref: 17 pid: 190662 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892679.278551:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055552640:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892679.278563:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892679.278583:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055552000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892679.278598:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892679.278621:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055552512:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.278622:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055552256:12345-0@lo:103:ldlm_bl.0 Request processed in 152us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892679.278635:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055551744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.278644:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 563 00000100:00100000:2.0:1789892679.278649:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055551872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892679.278667:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055551616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892679.278710:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055552256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.278728:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552384 00000100:00100000:0.0:1789892679.278733:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552384 00010000:00010000:0.0:1789892679.278746:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 16 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.278791:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 564 00000100:00100000:0.0:1789892679.278800:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055552384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892679.278808:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892679.278815:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 16 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278828:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 16 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278842:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383c00/0xd5b980e0d62af755 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af74e expref: 16 pid: 194990 timeout: 3469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278858:0:190655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278867:0:190655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278884:0:190655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278894:0:190655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278909:0:190655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278916:0:190655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278949:0:190655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6c00 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:0.0:1789892679.278954:0:190655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278963:0:190655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278981:0:190655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892679.278996:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892679.278997:0:217445:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.279006:0:217445:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892679.279012:0:217445:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217445 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892679.279047:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055552384:12345-0@lo:103:ldlm_bl.0 Request processed in 247us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892679.279057:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 564 00000100:00100000:2.0:1789892679.279078:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055552384:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892679.355894:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892679.355974:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892679.355994:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746752 00000100:00100000:2.0:1789892679.356012:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746752 00000100:00100000:3.0:1789892679.356032:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746624 00000100:00100000:3.0:1789892679.356036:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746624 00000100:00080000:1.0:1789892679.356099:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789892679.356106:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789892679.356120:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 503 00000100:00100000:3.0:1789892679.356129:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 504 00000100:00100000:2.0:1789892679.356135:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062746752:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892679.356140:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2396:x1876835062746624:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892679.356240:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2396:x1876835062746624:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 102us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892679.356240:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062746752:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 108us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892679.356250:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 504 00000100:00100000:2.0:1789892679.356255:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 503 00010000:00010000:1.0:1789892679.761902:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892680.571808:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892680.571885:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062746880 00000100:00100000:1.0:1789892680.571899:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062746880 00000100:00100000:1.0:1789892680.571985:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2365 00000100:00100000:1.0:1789892680.572000:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062746880:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892680.572023:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892680.572050:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26040f expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.572092:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.572106:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.572118:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6c00, rc 0) 00000100:00100000:1.0:1789892680.572187:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062746880:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 191us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.572196:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2365 00000100:00100000:0.0:1789892680.573119:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892680.573173:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747008 00000100:00100000:1.0:1789892680.573179:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747008 00000100:00100000:1.0:1789892680.573212:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2366 00000100:00100000:1.0:1789892680.573220:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062747008:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.573360:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062747008:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 139us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.573387:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2366 00000100:00100000:0.0:1789892680.574056:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892680.574096:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747136 00000100:00100000:2.0:1789892680.574100:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747136 00000100:00100000:2.0:1789892680.574129:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2367 00000100:00100000:2.0:1789892680.574135:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062747136:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.574224:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062747136:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 88us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.574232:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2367 00000100:00100000:2.0:1789892680.575263:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892680.575344:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747264 00000100:00100000:3.0:1789892680.575351:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747264 00000100:00100000:3.0:1789892680.575389:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2368 00000100:00100000:3.0:1789892680.575399:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216234:x1876835062747264:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892680.575496:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216234:x1876835062747264:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 99us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.575501:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2368 00000100:00100000:0.0:1789892680.576219:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892680.576258:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747392 00000100:00100000:1.0:1789892680.576262:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747392 00000100:00100000:1.0:1789892680.576285:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2369 00000100:00100000:1.0:1789892680.576290:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216234:x1876835062747392:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892680.576351:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216234:x1876835062747392:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 58us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.576360:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2369 00000100:00100000:0.0:1789892680.577217:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892680.577272:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747520 00000100:00100000:1.0:1789892680.577278:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747520 00000100:00100000:1.0:1789892680.577308:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2370 00000100:00100000:1.0:1789892680.577318:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062747520:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892680.577327:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892680.577338:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260416 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.577356:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 10 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.577367:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 10 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.577375:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7000, rc 0) 00000100:00100000:1.0:1789892680.577408:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062747520:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 89us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.577415:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2370 00000100:00100000:2.0:1789892680.578080:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892680.578124:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747648 00000100:00100000:0.0:1789892680.578129:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747648 00000100:00100000:0.0:1789892680.578157:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2371 00000100:00100000:0.0:1789892680.578164:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062747648:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.578217:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062747648:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 54us (138us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892680.578223:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2371 10000000:01000000:0.0:1789892680.593786:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892680.593792:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 184 10000000:01000000:0.0:1789892680.593798:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892680.593840:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.593850:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.593859:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.593894:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055552768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.593957:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.593996:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552768 00000100:00100000:0.0:1789892680.594001:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649240 going to sleep for 11 seconds 00000100:00100000:3.0:1789892680.594004:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552768 00000100:00100000:3.0:1789892680.594044:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2372 00000100:00100000:3.0:1789892680.594052:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055552768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.594062:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892680.594072:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af7d3 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.594116:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 16 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.594124:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 16 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.594130:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d800, rc 0) 00000100:00100000:3.0:1789892680.594169:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055552768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.594176:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2372 00000100:00100000:0.0:1789892680.594202:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055552768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892680.594219:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.594228:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.594282:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055552896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.594303:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.594318:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.594340:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055552896 00000100:00100000:1.0:1789892680.594344:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055552896 00000100:00100000:1.0:1789892680.594375:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2373 00000100:00100000:1.0:1789892680.594385:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055552896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.594487:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055552896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.594493:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2373 00000100:00100000:0.0:1789892680.594559:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055552896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.594586:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.594622:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.594648:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.594671:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553024 00000100:00100000:2.0:1789892680.594676:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553024 00000100:00100000:2.0:1789892680.594723:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2374 00000100:00100000:2.0:1789892680.594728:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055553024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.594799:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055553024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.594806:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2374 00000100:00100000:0.0:1789892680.594828:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.595131:0:217449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217449:1876835055553152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.595160:0:217449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.595182:0:217449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030816496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.595195:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553152 00000100:00100000:2.0:1789892680.595199:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553152 00000100:00100000:2.0:1789892680.595221:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2375 00000100:00100000:2.0:1789892680.595225:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217449:x1876835055553152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892680.595302:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217449:x1876835055553152:12345-0@lo:502:llog_process_th.0 Request processed in 76us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.595310:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2375 00000100:00100000:0.0:1789892680.595323:0:217449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217449:1876835055553152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.595362:0:217449:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217449:1876835055553280:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.595389:0:217449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.595407:0:217449:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030816496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892680.595433:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553280 00000100:00100000:3.0:1789892680.595438:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553280 00000100:00100000:3.0:1789892680.595465:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2376 00000100:00100000:3.0:1789892680.595473:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217449:x1876835055553280:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892680.595551:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217449:x1876835055553280:12345-0@lo:502:llog_process_th.0 Request processed in 78us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.595560:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2376 00000100:00100000:0.0:1789892680.595568:0:217449:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217449:1876835055553280:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892680.595587:0:217449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:3.0:1789892680.595676:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:3.0:1789892680.595713:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892680.595720:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.595730:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892680.595739:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892680.595742:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892680.595751:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892680.595767:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.595776:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.595785:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.595799:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.595825:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.595853:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903181254c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.595864:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553408 00000100:00100000:1.0:1789892680.595870:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553408 00000100:00100000:1.0:1789892680.595899:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2377 00000100:00100000:1.0:1789892680.595904:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055553408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892680.595911:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892680.595919:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af7e1 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.595949:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 17 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.595957:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 17 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.595962:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892680.595993:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055553408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 89us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.595998:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2377 00000100:00100000:3.0:1789892680.596025:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.596035:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.596041:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.596076:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.596096:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.596109:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903181254c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.596128:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553536 00000100:00100000:2.0:1789892680.596132:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553536 00000100:00100000:2.0:1789892680.596155:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2378 00000100:00100000:2.0:1789892680.596161:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055553536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.596225:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055553536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.596233:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2378 00000100:00100000:3.0:1789892680.596250:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.596273:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.596300:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.596314:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903181254c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.596334:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553664 00000100:00100000:2.0:1789892680.596338:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553664 00000100:00100000:2.0:1789892680.596358:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2379 00000100:00100000:2.0:1789892680.596362:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055553664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.596424:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055553664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.596435:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2379 00000100:00100000:3.0:1789892680.596445:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553664:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892680.597127:0:217450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:0.0:1789892680.597195:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:0.0:1789892680.597214:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789892680.597220:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.597230:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892680.597238:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892680.597240:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 184 10000000:01000000:0.0:1789892680.597242:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892680.597256:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.597264:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.597284:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.597298:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.597321:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.597345:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030816496c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892680.597353:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553792 00000100:00100000:3.0:1789892680.597358:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553792 00000100:00100000:3.0:1789892680.597384:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2380 00000100:00100000:3.0:1789892680.597392:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055553792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.597401:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892680.597410:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af7ef expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.597424:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 18 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.597434:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 18 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.597442:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d600, rc 0) 00000100:00100000:3.0:1789892680.597475:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055553792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (152us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.597483:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2380 00000100:00100000:0.0:1789892680.597498:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892680.597510:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.597519:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.597555:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.597582:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.597600:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030816496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.597624:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055553920 00000100:00100000:1.0:1789892680.597630:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055553920 00000100:00100000:1.0:1789892680.597656:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2381 00000100:00100000:1.0:1789892680.597663:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055553920:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.597756:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055553920:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.597765:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2381 00000100:00100000:0.0:1789892680.597768:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055553920:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.597800:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.597844:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.597871:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030816496c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.597879:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554048 00000100:00100000:2.0:1789892680.597883:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554048 00000100:00100000:2.0:1789892680.597908:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2382 00000100:00100000:2.0:1789892680.597913:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055554048:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.597983:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055554048:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.597990:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2382 00000100:00100000:0.0:1789892680.598003:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554048:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.598157:0:217451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217451:1876835055554176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.598193:0:217451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.598216:0:217451:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.598231:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554176 00000100:00100000:2.0:1789892680.598235:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554176 00000100:00100000:2.0:1789892680.598256:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2383 00000100:00100000:2.0:1789892680.598260:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217451:x1876835055554176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892680.598320:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217451:x1876835055554176:12345-0@lo:502:llog_process_th.0 Request processed in 59us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.598327:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2383 00000100:00100000:0.0:1789892680.598344:0:217451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217451:1876835055554176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.598377:0:217451:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217451:1876835055554304:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.598404:0:217451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.598421:0:217451:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892680.598437:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554304 00000100:00100000:3.0:1789892680.598442:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554304 00000100:00100000:3.0:1789892680.598468:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2384 00000100:00100000:3.0:1789892680.598475:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217451:x1876835055554304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892680.598542:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217451:x1876835055554304:12345-0@lo:502:llog_process_th.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.598550:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2384 00000100:00100000:0.0:1789892680.598555:0:217451:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217451:1876835055554304:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892680.598573:0:217451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:3.0:1789892680.598614:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:3.0:1789892680.598635:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892680.598641:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.598651:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892680.598660:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892680.598662:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789892680.598665:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892680.598701:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.598711:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.598720:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.598734:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.598762:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.598788:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.598800:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554432 00000100:00100000:1.0:1789892680.598805:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554432 00000100:00100000:1.0:1789892680.598833:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2385 00000100:00100000:1.0:1789892680.598838:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055554432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892680.598846:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892680.598853:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af7fd expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.598866:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.598874:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.598880:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6400, rc 0) 00000100:00100000:1.0:1789892680.598910:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055554432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.598917:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2385 00000100:00100000:3.0:1789892680.598937:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.598949:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.598956:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.598983:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.599009:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.599022:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.599046:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554560 00000100:00100000:2.0:1789892680.599051:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554560 00000100:00100000:2.0:1789892680.599077:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2386 00000100:00100000:2.0:1789892680.599084:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055554560:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.599152:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055554560:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.599158:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554560:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.599163:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2386 00000100:00100000:3.0:1789892680.599187:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554688:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.599216:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.599229:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031ba04e180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.599238:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554688 00000100:00100000:2.0:1789892680.599242:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554688 00000100:00100000:2.0:1789892680.599264:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2387 00000100:00100000:2.0:1789892680.599269:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055554688:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.599336:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055554688:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.599344:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2387 00000100:00100000:3.0:1789892680.599351:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554688:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892680.599955:0:217452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:0.0:1789892680.600010:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:0.0:1789892680.600025:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789892680.600031:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.600040:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892680.600049:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892680.600050:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 184 10000000:01000000:0.0:1789892680.600053:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892680.600067:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.600075:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.600084:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.600096:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.600131:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.600156:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649780 going to sleep for 11 seconds 00000100:00100000:3.0:1789892680.600163:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554816 00000100:00100000:3.0:1789892680.600168:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554816 00000100:00100000:3.0:1789892680.600194:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2388 00000100:00100000:3.0:1789892680.600201:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055554816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.600208:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892680.600216:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af80b expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.600227:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 20 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.600233:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 20 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.600238:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d200, rc 0) 00000100:00100000:3.0:1789892680.600267:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055554816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 66us (135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.600274:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2388 00000100:00100000:0.0:1789892680.600293:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892680.600304:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.600314:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.600349:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.600373:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.600391:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649780 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.600423:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055554944 00000100:00100000:1.0:1789892680.600430:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055554944 00000100:00100000:1.0:1789892680.600463:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2389 00000100:00100000:1.0:1789892680.600473:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055554944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.600553:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055554944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 81us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892680.600568:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055554944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.600579:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2389 00000100:00100000:0.0:1789892680.600592:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.600624:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.600638:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.600651:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555072 00000100:00100000:2.0:1789892680.600656:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555072 00000100:00100000:2.0:1789892680.600695:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2390 00000100:00100000:2.0:1789892680.600701:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055555072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.600755:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055555072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 54us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.600762:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2390 00000100:00100000:0.0:1789892680.600771:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.600915:0:217453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217453:1876835055555200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.600962:0:217453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.600986:0:217453:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.600994:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555200 00000100:00100000:2.0:1789892680.600998:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555200 00000100:00100000:2.0:1789892680.601021:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2391 00000100:00100000:2.0:1789892680.601025:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217453:x1876835055555200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892680.601086:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217453:x1876835055555200:12345-0@lo:502:llog_process_th.0 Request processed in 59us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.601093:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2391 00000100:00100000:0.0:1789892680.601103:0:217453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217453:1876835055555200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.601137:0:217453:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217453:1876835055555328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.601164:0:217453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.601185:0:217453:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649180 going to sleep for 11 seconds 00000100:00100000:3.0:1789892680.601202:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555328 00000100:00100000:3.0:1789892680.601207:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555328 00000100:00100000:3.0:1789892680.601234:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2392 00000100:00100000:3.0:1789892680.601241:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217453:x1876835055555328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892680.601312:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217453:x1876835055555328:12345-0@lo:502:llog_process_th.0 Request processed in 71us (146us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.601320:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2392 00000100:00100000:0.0:1789892680.601334:0:217453:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217453:1876835055555328:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892680.601354:0:217453:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:3.0:1789892680.601394:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:3.0:1789892680.601409:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892680.601415:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.601424:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892680.601433:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:3.0:1789892680.601435:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 209 10000000:01000000:3.0:1789892680.601438:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892680.601452:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.601461:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.601469:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.601482:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.601507:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.601530:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.601547:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555456 00000100:00100000:1.0:1789892680.601552:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555456 00000100:00100000:1.0:1789892680.601575:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2393 00000100:00100000:1.0:1789892680.601580:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055555456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892680.601586:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892680.601594:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af819 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.601605:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.601611:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.601616:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6e00, rc 0) 00000100:00100000:1.0:1789892680.601644:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055555456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (137us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.601649:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2393 00000100:00100000:3.0:1789892680.601672:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.601711:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.601722:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.601761:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.601787:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892680.601815:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555584 00000100:00100000:3.0:1789892680.601817:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.601819:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555584 00000100:00100000:2.0:1789892680.601845:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2394 00000100:00100000:2.0:1789892680.601853:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055555584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.601937:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055555584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.601946:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2394 00000100:00100000:3.0:1789892680.601949:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.601983:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.602019:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.602038:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.602042:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555712 00000100:00100000:2.0:1789892680.602047:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555712 00000100:00100000:2.0:1789892680.602074:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2395 00000100:00100000:2.0:1789892680.602078:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055555712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.602137:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055555712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 58us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.602143:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2395 00000100:00100000:3.0:1789892680.602155:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055555712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.602317:0:217454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217454:1876835055555840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892680.602347:0:217454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.602362:0:217454:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.602386:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555840 00000100:00100000:1.0:1789892680.602391:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555840 00000100:00100000:1.0:1789892680.602419:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2396 00000100:00100000:1.0:1789892680.602424:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217454:x1876835055555840:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892680.602499:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217454:x1876835055555840:12345-0@lo:502:llog_process_th.0 Request processed in 75us (151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.602505:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2396 00000100:00100000:3.0:1789892680.602524:0:217454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217454:1876835055555840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892680.602546:0:217454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892680.602556:0:217454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892680.602559:0:217454:0:(obd_config.c:1561:class_process_config()) marker 197 (0x1) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:3.0:1789892680.602563:0:217454:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892680.602583:0:217454:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000100:00100000:3.0:1789892680.602596:0:217454:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217454:1876835055555968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892680.602625:0:217454:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.602640:0:217454:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.602657:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055555968 00000100:00100000:1.0:1789892680.602666:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055555968 00000100:00100000:1.0:1789892680.602708:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2397 00000100:00100000:1.0:1789892680.602716:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217454:x1876835055555968:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892680.602771:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217454:x1876835055555968:12345-0@lo:502:llog_process_th.0 Request processed in 57us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.602777:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2397 00000100:00100000:3.0:1789892680.602792:0:217454:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217454:1876835055555968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892680.602814:0:217454:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892680.602818:0:217454:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892680.602819:0:217454:0:(obd_config.c:1561:class_process_config()) marker 197 (0x2) lustre-MDT0001-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:3.0:1789892680.602822:0:217454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 212 count 208 00000020:01000000:0.0:1789892680.602870:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 209-211 (rc=0) 10000000:01000000:0.0:1789892680.602890:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:0.0:1789892680.602896:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.602905:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892680.602914:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789892680.602916:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 184 10000000:01000000:0.0:1789892680.602918:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789892680.602946:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.602954:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.602974:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.602986:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.603013:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.603038:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.603053:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556096 00000100:00100000:2.0:1789892680.603059:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556096 00000100:00100000:2.0:1789892680.603089:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2398 00000100:00100000:2.0:1789892680.603098:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055556096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892680.603106:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892680.603117:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af827 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892680.603134:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 22 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892680.603141:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 22 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892680.603146:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383e00, rc 0) 00000100:00100000:2.0:1789892680.603174:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055556096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.603179:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2398 00000100:00100000:0.0:1789892680.603201:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892680.603212:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892680.603228:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892680.603258:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.603285:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.603299:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649240 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.603324:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556224 00000100:00100000:2.0:1789892680.603328:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556224 00000100:00100000:2.0:1789892680.603349:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2399 00000100:00100000:2.0:1789892680.603355:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055556224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892680.603410:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055556224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 56us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.603422:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2399 00000100:00100000:0.0:1789892680.603433:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.603457:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.603484:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.603498:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649240 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.603515:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556352 00000100:00100000:1.0:1789892680.603519:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556352 00000100:00100000:1.0:1789892680.603540:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2400 00000100:00100000:1.0:1789892680.603544:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055556352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.603598:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055556352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 52us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.603604:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2400 00000100:00100000:0.0:1789892680.603615:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892680.603791:0:217455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217455:1876835055556480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.603824:0:217455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.603851:0:217455:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.603855:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556480 00000100:00100000:1.0:1789892680.603860:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556480 00000100:00100000:1.0:1789892680.603881:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2401 00000100:00100000:1.0:1789892680.603885:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217455:x1876835055556480:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892680.603965:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217455:x1876835055556480:12345-0@lo:502:llog_process_th.0 Request processed in 78us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.603971:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2401 00000100:00100000:0.0:1789892680.603982:0:217455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217455:1876835055556480:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.604014:0:217455:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217455:1876835055556608:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892680.604041:0:217455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892680.604055:0:217455:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.604074:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556608 00000100:00100000:2.0:1789892680.604080:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556608 00000100:00100000:2.0:1789892680.604108:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2402 00000100:00100000:2.0:1789892680.604113:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217455:x1876835055556608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892680.604182:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217455:x1876835055556608:12345-0@lo:502:llog_process_th.0 Request processed in 68us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.604189:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2402 00000100:00100000:0.0:1789892680.604196:0:217455:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217455:1876835055556608:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789892680.604216:0:217455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000020:01000000:3.0:1789892680.604279:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 184-186 (rc=0) 10000000:01000000:3.0:1789892680.604294:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892680.604300:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.604310:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892680.604318:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789892680.604320:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 209 10000000:01000000:3.0:1789892680.604323:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892680.604337:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.604346:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.604354:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.604366:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.604392:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.604416:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.604434:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556736 00000100:00100000:2.0:1789892680.604439:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556736 00000100:00100000:2.0:1789892680.604467:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2403 00000100:00100000:2.0:1789892680.604475:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055556736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892680.604484:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892680.604495:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af835 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892680.604511:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892680.604518:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892680.604523:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382c00, rc 0) 00000100:00100000:2.0:1789892680.604552:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055556736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.604557:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2403 00000100:00100000:3.0:1789892680.604579:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892680.604591:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.604597:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.604624:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.604643:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.604656:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.604698:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556864 00000100:00100000:1.0:1789892680.604704:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556864 00000100:00100000:1.0:1789892680.604731:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2404 00000100:00100000:1.0:1789892680.604739:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055556864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.604810:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055556864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.604824:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.604835:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2404 00000100:00100000:3.0:1789892680.604849:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.604881:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.604903:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a600 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.604911:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055556992 00000100:00100000:1.0:1789892680.604916:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055556992 00000100:00100000:1.0:1789892680.604956:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2405 00000100:00100000:1.0:1789892680.604975:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055556992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.605052:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055556992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892680.605061:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2405 00000100:00100000:3.0:1789892680.605068:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055556992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.605220:0:217456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217456:1876835055557120:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892680.605262:0:217456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.605276:0:217456:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.605289:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557120 00000100:00100000:2.0:1789892680.605299:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557120 00000100:00100000:2.0:1789892680.605323:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2406 00000100:00100000:2.0:1789892680.605328:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217456:x1876835055557120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892680.605401:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217456:x1876835055557120:12345-0@lo:502:llog_process_th.0 Request processed in 72us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.605407:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2406 00000100:00100000:3.0:1789892680.605415:0:217456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217456:1876835055557120:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892680.605436:0:217456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892680.605441:0:217456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892680.605443:0:217456:0:(obd_config.c:1561:class_process_config()) marker 196 (0x1) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000020:00000080:3.0:1789892680.605446:0:217456:0:(obd_config.c:1470:class_process_config()) processing cmd: ce022 00020000:01000000:3.0:1789892680.605453:0:217456:0:(lod_pool.c:649:lod_pool_remove()) lustre-OST0001_UUID removed from qpool2 00000020:01000004:3.0:1789892680.605792:0:217457:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000100:00100000:0.0:1789892680.605800:0:217456:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217456:1876835055557248:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789892680.605802:0:217457:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:0.0:1789892680.605833:0:217456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892680.605873:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557248 00000100:00100000:0.0:1789892680.605878:0:217456:0:(client.c:2702:ptlrpc_set_wait()) set ffff903081649180 going to sleep for 11 seconds 00000100:00100000:2.0:1789892680.605879:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557248 00000100:00100000:2.0:1789892680.605905:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2407 00000100:00100000:2.0:1789892680.605910:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217456:x1876835055557248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892680.605978:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217456:x1876835055557248:12345-0@lo:502:llog_process_th.0 Request processed in 67us (145us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892680.605983:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2407 00000100:00100000:0.0:1789892680.606010:0:217456:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217456:1876835055557248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892680.606032:0:217456:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892680.606036:0:217456:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892680.606038:0:217456:0:(obd_config.c:1561:class_process_config()) marker 196 (0x2) lustre-MDT0000-m rem lustre.qpool2.lustre-OST0001_UUID 00000040:00080000:0.0:1789892680.606042:0:217456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 212 count 208 00000020:01000000:3.0:1789892680.606087:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 209-211 (rc=0) 10000000:01000000:3.0:1789892680.606102:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789892680.606109:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.606119:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892680.606127:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789892680.606129:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:3.0:1789892680.606132:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789892680.606146:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.606154:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.606162:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.606172:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055557376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.606193:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.606207:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.606233:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557376 00000100:00100000:1.0:1789892680.606239:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557376 00000100:00100000:1.0:1789892680.606268:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2408 00000100:00100000:1.0:1789892680.606276:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055557376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892680.606285:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892680.606294:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af843 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.606310:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.606320:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.606328:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6800, rc 0) 00000100:00100000:1.0:1789892680.606367:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055557376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892680.606377:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055557376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.606378:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2408 00010000:00010000:3.0:1789892680.606390:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.606399:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892680.606441:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055557504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892680.606460:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892680.606473:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308365a000 going to sleep for 11 seconds 00000100:00100000:1.0:1789892680.606497:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557504 00000100:00100000:1.0:1789892680.606509:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557504 00000100:00100000:1.0:1789892680.606532:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2409 00000100:00100000:1.0:1789892680.606536:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055557504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892680.606580:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055557504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 43us (119us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892680.606587:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2409 00000100:00100000:3.0:1789892680.606598:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055557504:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789892680.606617:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789892680.606621:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892680.606627:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892680.785851:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892681.745821:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789892681.745853:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055557632:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892681.745965:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892681.746009:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557632 00000100:00100000:1.0:1789892681.746020:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557632 00000100:00100000:1.0:1789892681.746097:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789892681.746112:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055557632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789892681.746155:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789892681.746222:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055557632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 114us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892681.746232:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789892681.746295:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055557632:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892681.809799:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789892681.835792:0:217556:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc63b69ec0 20000000:00000080:3.0:1789892681.835809:0:217556:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90309190d000 uarg=0000000000000000 00000040:00100000:3.0:1789892681.836340:0:217556:0:(llog.c:1072:llog_reverse_process()) index 186 : idx 181 20000000:01000000:3.0:1789892681.836347:0:217556:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 185 cmd:0xce022 lustre.qpool2 lustre-OST0001_UUID 20000000:01000000:3.0:1789892681.836361:0:217556:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-clilov/new lustre.qpool2 fl=4 20000000:01000000:3.0:1789892681.836699:0:217557:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 168 marker 180 1->4: lustre-clilov new lustre.qpool2 20000000:01000000:3.0:1789892681.836765:0:217557:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 170 marker 180 2->4: lustre-clilov new lustre.qpool2 00000040:00080000:3.0:1789892681.836779:0:217557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 187 count 183 00000040:00080000:1.0:1789892681.836908:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].187, 224 off42312 20000000:01000000:1.0:1789892681.836944:0:217556:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892681.836958:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].188, 104 off42416 00000040:00080000:1.0:1789892681.836969:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].189, 224 off42640 20000000:01000000:1.0:1789892681.836980:0:217556:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0000-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:3.0:1789892681.837185:0:217558:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 194 marker 181 1->4: lustre-MDT0000-mdtlov new lustre.qpool2 20000000:01000000:3.0:1789892681.837203:0:217558:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 196 marker 181 2->4: lustre-MDT0000-mdtlov new lustre.qpool2 00000040:00080000:3.0:1789892681.837213:0:217558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 212 count 208 00000040:00080000:1.0:1789892681.837287:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].212, 224 off47128 20000000:01000000:1.0:1789892681.837295:0:217556:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892681.837304:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].213, 112 off47240 00000040:00080000:1.0:1789892681.837314:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].214, 224 off47464 20000000:01000000:1.0:1789892681.837321:0:217556:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre-MDT0001-mdtlov/new lustre.qpool2 fl=4 20000000:01000000:3.0:1789892681.837584:0:217559:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 194 marker 182 1->4: lustre-MDT0001-mdtlov new lustre.qpool2 20000000:01000000:3.0:1789892681.837602:0:217559:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 196 marker 182 2->4: lustre-MDT0001-mdtlov new lustre.qpool2 00000040:00080000:3.0:1789892681.837624:0:217559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 212 count 208 00000040:00080000:1.0:1789892681.837755:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].212, 224 off47128 20000000:01000000:1.0:1789892681.837765:0:217556:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce023 lustre qpool2 (null) (null) 00000040:00080000:1.0:1789892681.837778:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].213, 112 off47240 00000040:00080000:1.0:1789892681.837791:0:217556:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].214, 224 off47464 10000000:01000000:1.0:1789892681.837816:0:217556:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892681.837838:0:217556:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837858:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837865:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837872:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837876:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837880:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837885:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837889:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837894:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837898:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837903:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837912:0:217556:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837932:0:217556:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837976:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.837989:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 23 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838004:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055557760:0@lo:104: 00000100:00100000:1.0:1789892681.838075:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892681.838119:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557760 00000100:00100000:2.0:1789892681.838128:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557760 00010000:00010000:1.0:1789892681.838130:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.838139:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 23 pid: 190663 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838149:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055557888:0@lo:104: 00000100:00100000:1.0:1789892681.838175:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892681.838197:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892681.838204:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.838209:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055557888 00000100:00100000:2.0:1789892681.838213:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055557888 00010000:00010000:1.0:1789892681.838214:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 23 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838219:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:1.0:1789892681.838227:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558016:0@lo:104: 00000100:00100000:3.0:1789892681.838241:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055557760:12345-0@lo:104: 00000100:00100000:2.0:1789892681.838252:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00010000:00010000:3.0:1789892681.838256:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.838265:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903084af2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055557888:12345-0@lo:104: 00000100:00100000:1.0:1789892681.838270:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892681.838277:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892681.838306:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558016 00010000:00010000:1.0:1789892681.838307:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892681.838313:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558016 00010000:00010000:1.0:1789892681.838322:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 23 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838335:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558144:0@lo:104: 00010000:00010000:3.0:1789892681.838348:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789892681.838350:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 511 00010000:00010000:2.0:1789892681.838358:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892681.838362:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217556:x1876835055557760:12345-0@lo:104: Request processed in 124us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892681.838363:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217556:x1876835055558016:12345-0@lo:104: 00000100:00100000:1.0:1789892681.838364:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892681.838377:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903084af2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:217556:x1876835055557888:12345-0@lo:104: Request processed in 114us (198us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892681.838381:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838385:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00010000:00010000:1.0:1789892681.838387:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.838396:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00010000:00010000:1.0:1789892681.838406:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 23 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838415:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558144 00000100:00100000:1.0:1789892681.838417:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558272:0@lo:104: 00000100:00100000:3.0:1789892681.838421:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558144 00010000:00010000:0.0:1789892681.838451:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892681.838459:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1789892681.838460:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892681.838462:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558016:12345-0@lo:104: Request processed in 101us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892681.838472:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 511 00000100:00100000:2.0:1789892681.838473:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558272 00000100:00100000:3.0:1789892681.838479:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558144:12345-0@lo:104: 00000100:00100000:2.0:1789892681.838480:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558272 00010000:00010000:1.0:1789892681.838485:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.838492:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838494:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892681.838497:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 23 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838503:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.838512:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00010000:00010000:0.0:1789892681.838523:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c200 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:2.0:1789892681.838525:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558272:12345-0@lo:104: 00000100:00100000:1.0:1789892681.838526:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558400:0@lo:104: 10000000:00010000:0.0:1789892681.838528:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838539:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838540:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.838547:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892681.838558:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558144:12345-0@lo:104: Request processed in 86us (197us total) trans 0 rc 0/0 10000000:00010000:0.0:1789892681.838560:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838563:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789892681.838573:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892681.838577:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00010000:00010000:2.0:1789892681.838578:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789892681.838586:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.838587:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558272:12345-0@lo:104: Request processed in 64us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892681.838595:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558400 00000100:00100000:2.0:1789892681.838596:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00010000:00010000:1.0:1789892681.838597:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 23 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838601:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558400 00010000:00010000:0.0:1789892681.838618:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838621:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000100:00100000:1.0:1789892681.838624:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558528:0@lo:104: 00010000:00010000:2.0:1789892681.838629:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838638:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00010000:00010000:0.0:1789892681.838641:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892681.838649:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9da00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892681.838651:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217556:x1876835055558400:12345-0@lo:104: 10000000:00010000:2.0:1789892681.838655:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838660:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892681.838664:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838666:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838670:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838701:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c200/0xd5b980e0d62af843 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af84a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.838706:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892681.838715:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.838723:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 10000000:01000000:2.0:1789892681.838724:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892681.838727:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892681.838728:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 23 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838734:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217556:x1876835055558400:12345-0@lo:104: Request processed in 83us (171us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892681.838735:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838750:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558784:0@lo:104: 00010000:00010000:2.0:1789892681.838751:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838754:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98800 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892681.838760:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 10000000:00010000:0.0:1789892681.838761:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838770:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892681.838774:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838778:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558528 10000000:00010000:0.0:1789892681.838781:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838784:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558528 00000100:00100000:1.0:1789892681.838787:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:0.0:1789892681.838794:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892681.838795:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838803:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558784 00000100:00100000:3.0:1789892681.838807:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558784 00010000:00010000:2.0:1789892681.838811:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9da00/0xd5b980e0d62af835 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af83c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838825:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838827:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789892681.838832:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838833:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00010000:00010000:2.0:1789892681.838836:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838847:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558528:12345-0@lo:104: 00010000:00010000:0.0:1789892681.838847:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892681.838855:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892681.838855:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 23 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838859:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.838862:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892681.838862:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838869:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055559168:0@lo:104: 00010000:00010000:0.0:1789892681.838883:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98800/0xd5b980e0d62af827 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af82e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838887:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892681.838897:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.838897:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892681.838903:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.838904:0:217556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1789892681.838912:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892681.838929:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99600 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892681.838932:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1789892681.838934:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838941:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558528:12345-0@lo:104: Request processed in 95us (282us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892681.838944:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838947:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.838950:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838953:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00010000:00010000:2.0:1789892681.838968:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892681.838969:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838973:0:190654:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892681.838974:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.838978:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.838986:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055559168 10000000:01000000:0.0:1789892681.838988:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892681.838991:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055559168 00000100:00100000:1.0:1789892681.839004:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055559424:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892681.839009:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af819 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af820 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839010:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00010000:00010000:0.0:1789892681.839014:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839021:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558784:12345-0@lo:104: 00010000:00010000:2.0:1789892681.839031:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892681.839032:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892681.839035:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839039:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839040:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839061:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9dc00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892681.839069:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839072:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62af80b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af812 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.839076:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1789892681.839077:0:217556:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839087:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839089:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:217556:x1876835055558784:12345-0@lo:104: Request processed in 69us (305us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892681.839096:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892681.839102:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839109:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 10000000:00010000:2.0:1789892681.839109:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839123:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99200 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892681.839124:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00010000:00010000:1.0:1789892681.839130:0:217556:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 9 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892681.839131:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:0.0:1789892681.839131:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839138:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903093cd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217556:x1876835055559168:12345-0@lo:104: 00010000:00010000:2.0:1789892681.839153:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839154:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.839159:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839160:0:217556:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055559680:192.168.203.53@tcp:104: 10000000:00010000:0.0:1789892681.839177:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839178:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:0.0:1789892681.839187:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892681.839189:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839195:0:217556:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031860b8e40 going to sleep for 11 seconds 00010000:00010000:2.0:1789892681.839198:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9dc00/0xd5b980e0d62af7fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af804 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839205:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.839206:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892681.839210:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:3.0:1789892681.839216:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903093cd1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:217556:x1876835055559168:12345-0@lo:104: Request processed in 80us (311us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892681.839217:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892681.839222:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839225:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055557760:0@lo:104: 00010000:00010000:0.0:1789892681.839226:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839230:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00010000:00010000:2.0:1789892681.839241:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892681.839242:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99200/0xd5b980e0d62af7ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7f6 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839248:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055557888:0@lo:104: 10000000:00010000:2.0:1789892681.839249:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839258:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839259:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:2.0:1789892681.839266:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839267:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558016:0@lo:104: 00010000:00010000:0.0:1789892681.839269:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839277:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558144:0@lo:104: 10000000:01000000:2.0:1789892681.839279:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892681.839290:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892681.839293:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839296:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558272:0@lo:104: 00010000:00010000:2.0:1789892681.839301:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839301:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839308:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd86a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558400:0@lo:104: 00010000:00010000:2.0:1789892681.839320:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892681.839320:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558528:0@lo:104: 10000000:00010000:0.0:1789892681.839322:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839329:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892681.839329:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892681.839330:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055558784:0@lo:104: 00010000:00010000:3.0:1789892681.839340:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892681.839342:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af7e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7e8 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839348:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055559168:0@lo:104: 00010000:00010000:0.0:1789892681.839354:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839355:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892681.839360:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892681.839362:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892681.839366:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892681.839366:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892681.839368:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839375:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98200/0xd5b980e0d62af7d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af7da expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.839380:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892681.839384:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055558912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892681.839386:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055558656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892681.839388:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892681.839392:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892681.839396:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892681.839411:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055559296:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892681.839421:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892681.839424:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055559040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892681.839452:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892681.839461:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055559552:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892681.839482:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892681.839485:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055560064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892681.839505:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558656 00000100:00100000:1.0:1789892681.839511:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558656 00000100:00100000:3.0:1789892681.839526:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055559936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892681.839532:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892681.839538:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 24 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839565:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892681.839576:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055559296 00000100:00100000:0.0:1789892681.839584:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055559040 00000100:00100000:1.0:1789892681.839589:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055559296 00000100:00100000:0.0:1789892681.839590:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055559040 00000100:00100000:3.0:1789892681.839609:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892681.839610:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560064 00000100:00100000:2.0:1789892681.839616:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560064 00010000:00010000:1.0:1789892681.839619:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 26 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839619:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 26 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839623:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055560192:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892681.839637:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 27 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839653:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055559936 00000100:00100000:1.0:1789892681.839656:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055559936 00000100:00100000:0.0:1789892681.839662:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055559552 00000100:00100000:0.0:1789892681.839666:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055559552 00000100:00100000:2.0:1789892681.839667:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 565 00010000:00010000:1.0:1789892681.839668:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 28 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.839701:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3619:x1876835055558656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892681.839704:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 29 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839719:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892681.839719:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 566 00010000:00010000:2.0:1789892681.839727:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 29 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839728:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3618:x1876835055559296:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892681.839735:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 567 00010000:00010000:1.0:1789892681.839736:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892681.839745:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 29 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.839745:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 29 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839748:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892681.839750:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3621:x1876835055559040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892681.839765:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892681.839766:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 29 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839772:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 29 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839787:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62af84a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af843 expref: 29 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.839788:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af820 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af819 expref: 29 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839791:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 29 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892681.839801:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892681.839811:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892681.839812:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892681.839819:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055559808:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892681.839820:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383e00/0xd5b980e0d62af82e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af827 expref: 27 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839837:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892681.839859:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3618:x1876835055559296:12345-0@lo:103:ldlm_bl.0 Request processed in 131us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892681.839862:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055558656:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892681.839865:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892681.839873:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 566 00000100:00100000:2.0:1789892681.839878:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 565 00000100:00100000:0.0:1789892681.839885:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3621:x1876835055559040:12345-0@lo:103:ldlm_bl.0 Request processed in 140us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892681.839893:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 567 00000100:00100000:1.0:1789892681.839895:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560192 00000100:00100000:2.0:1789892681.839897:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055558912 00000100:00100000:2.0:1789892681.839901:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055558912 00000100:00100000:1.0:1789892681.839901:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560192 00000100:00100000:0.0:1789892681.839911:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055559808 00000100:00100000:0.0:1789892681.839929:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055559808 00010000:00010000:2.0:1789892681.839932:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 25 pid: 190663 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.839932:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 25 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.839946:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 26 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.839957:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1789892681.839968:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055558656:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892681.839970:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 569 00000100:00100000:1.0:1789892681.839974:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3618:x1876835055560064:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892681.839981:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3621:x1876835055559936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892681.839987:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892681.839988:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892681.839993:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 570 00010000:00010000:1.0:1789892681.839994:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 26 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.839995:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 26 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892681.840005:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055559552:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892681.840008:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 26 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.840021:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892681.840029:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 26 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.840030:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 26 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.840030:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af7e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af7e1 expref: 26 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.840053:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 25 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.840064:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892681.840065:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d600/0xd5b980e0d62af7f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af7ef expref: 25 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.840071:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d200/0xd5b980e0d62af812 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af80b expref: 25 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.840077:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892681.840082:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892681.840096:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055560064:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892681.840107:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3621:x1876835055559936:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892681.840117:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1789892681.840123:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3619:x1876835055559552:12345-0@lo:103:ldlm_bl.0 Request processed in 120us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892681.840127:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 568 00000100:00100000:3.0:1789892681.840132:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055558912:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892681.840139:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 569 00010000:00010000:3.0:1789892681.840143:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892681.840148:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 570 00010000:00010000:3.0:1789892681.840152:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 21 pid: 190663 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892681.840155:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 572 00000100:00100000:2.0:1789892681.840164:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1789892681.840168:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3619:x1876835055560192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892681.840174:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055559808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892681.840178:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 20 pid: 190663 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.840179:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892681.840182:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892681.840188:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055559296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892681.840190:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 20 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.840190:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 20 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892681.840198:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382c00/0xd5b980e0d62af83c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af835 expref: 20 pid: 190663 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892681.840203:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055560064:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892681.840211:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 20 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.840224:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 19 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892681.840233:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055559552:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892681.840235:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892681.840243:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9d800/0xd5b980e0d62af7da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af7d3 expref: 19 pid: 190662 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.840245:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6400/0xd5b980e0d62af804 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af7fd expref: 19 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.840255:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892681.840256:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892681.840278:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3620:x1876835055558912:12345-0@lo:103:ldlm_bl.0 Request processed in 150us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892681.840286:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 571 00000100:00100000:0.0:1789892681.840288:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055559040:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892681.840299:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3620:x1876835055559808:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892681.840305:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3619:x1876835055560192:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892681.840308:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055559936:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892681.840313:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 573 00000100:00100000:1.0:1789892681.840320:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 572 00000100:00100000:0.0:1789892681.840354:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055560192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892681.840355:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055558912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892681.840374:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055559808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892681.840757:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd86300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055559424:192.168.203.53@tcp:104: 00000100:00100000:1.0:1789892681.840768:0:217556:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:217556:1876835055559680:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892681.840798:0:217556:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.840964:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892681.840993:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747776 00000100:00100000:0.0:1789892681.841001:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747776 00010000:00010000:0.0:1789892681.841016:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 10 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892681.841038:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 574 00000100:00100000:0.0:1789892681.841044:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2396:x1876835062747776:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892681.841051:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892681.841055:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 10 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.841066:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 10 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.841072:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:0.0:1789892681.841082:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6c00/0xd5b980e0d62af7c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26040f expref: 10 pid: 194990 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892681.841090:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892681.841123:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062747904 00000100:00100000:0.0:1789892681.841125:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062747776:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 80us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892681.841130:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062747904 00000100:00100000:0.0:1789892681.841133:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 574 00010000:00010000:2.0:1789892681.841155:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.841184:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 575 00000100:00100000:2.0:1789892681.841193:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062747904:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789892681.841202:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892681.841207:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841218:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841230:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7000/0xd5b980e0d62af7cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260416 expref: 9 pid: 190664 timeout: 3472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841243:0:190656:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841252:0:190656:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841265:0:190656:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841273:0:190656:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841281:0:190656:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841298:0:190656:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841302:0:190656:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6600 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:2.0:1789892681.841305:0:190656:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841310:0:190656:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841324:0:190656:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892681.841335:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892681.841344:0:217556:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.841352:0:217556:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892681.841358:0:217556:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af851 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 217556 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892681.841365:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062747904:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 174us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892681.841372:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 575 00000100:00100000:1.0:1789892682.257866:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055560320:0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.257876:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055560704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892682.257882:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055560960:0@lo:400:kworker.0 00000100:00100000:2.0:1789892682.257991:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892682.257991:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892682.257992:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892682.258000:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055560832:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892682.258048:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055560576:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892682.258055:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055560448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892682.258062:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055561472:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258063:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892682.258093:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892682.258102:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055561344:0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258110:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892682.258115:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892682.258132:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055561088:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258139:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892682.258151:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876835055561984:0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258155:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055561216:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258167:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055561856:0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.258172:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892682.258190:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892682.258206:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055561600:0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258221:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560704 00000100:00100000:1.0:1789892682.258231:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560704 00000100:00100000:3.0:1789892682.258232:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560320 00000100:00100000:3.0:1789892682.258240:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560320 00000100:00100000:0.0:1789892682.258258:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892682.258263:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561984 00000100:00100000:2.0:1789892682.258269:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561984 00000100:00100000:0.0:1789892682.258287:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055562112:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258294:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560576 00000100:00100000:3.0:1789892682.258299:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560576 00000100:00100000:1.0:1789892682.258307:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560832 00000100:00100000:1.0:1789892682.258313:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560832 00000100:00100000:0.0:1789892682.258319:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892682.258322:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 505 00000100:00100000:3.0:1789892682.258323:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561344 00000100:00100000:3.0:1789892682.258329:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561344 00000100:00100000:2.0:1789892682.258341:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876835055561984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258352:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789892682.258361:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560448 00000100:00100000:3.0:1789892682.258367:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055560320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258367:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560448 00000100:00100000:0.0:1789892682.258375:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1789892682.258390:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055560576:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789892682.258398:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1789892682.258410:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055560704:12345-0@lo:13:osp-pre-1-0.0 00000004:00000024:0.0:1789892682.258430:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:2.0:1789892682.258433:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3619:x1876835055561984:12345-0@lo:400:kworker.0 Request processed in 98us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892682.258443:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055560320:12345-0@lo:400:kworker.0 Request processed in 76us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892682.258448:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 505 00002000:00000024:1.0:1789892682.258450:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892682.258461:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789892682.258476:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562112 00000100:00100000:2.0:1789892682.258481:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562112 00000100:00100000:3.0:1789892682.258490:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789892682.258490:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055560576:12345-0@lo:41:osp-pre-0-1.0 Request processed in 103us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892682.258504:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055561344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.258505:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789892682.258514:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055560704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892682.258519:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 506 00000100:00100000:1.0:1789892682.258532:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789892682.258534:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055562112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.258541:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789892682.258547:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055561344:12345-0@lo:400:kworker.0 Request processed in 48us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892682.258555:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055560832:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892682.258558:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789892682.258565:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00002000:00000024:0.0:1789892682.258575:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892682.258582:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055560448:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892682.258585:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba325500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055562112:12345-0@lo:400:kworker.0 Request processed in 54us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892682.258589:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055560960 00000100:00100000:2.0:1789892682.258599:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 506 00000100:00100000:3.0:1789892682.258604:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055560960 00000100:00100000:0.0:1789892682.258610:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055560832:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (545us total) trans 0 rc 0/0 00002000:00000024:1.0:1789892682.258613:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892682.258621:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789892682.258627:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892682.258641:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561472 00000100:00100000:3.0:1789892682.258645:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561472 00000100:00100000:0.0:1789892682.258652:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561856 00000100:00100000:0.0:1789892682.258659:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561856 00000100:00100000:3.0:1789892682.258665:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561088 00000100:00100000:1.0:1789892682.258669:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055560448:12345-0@lo:13:osp-pre-0-1.0 Request processed in 91us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892682.258670:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561088 00000100:00100000:1.0:1789892682.258713:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789892682.258716:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561600 00000100:00100000:2.0:1789892682.258721:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055560832:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892682.258722:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561600 00000100:00100000:0.0:1789892682.258727:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 507 00000100:00100000:0.0:1789892682.258739:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055561856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892682.258745:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055561344:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258746:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789892682.258758:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789892682.258761:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055560960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258775:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055561472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892682.258782:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055561856:0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.258782:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055561856:12345-0@lo:400:kworker.0 Request processed in 47us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892682.258790:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 507 00000100:00100000:3.0:1789892682.258808:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c66300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055560960:12345-0@lo:400:kworker.0 Request processed in 50us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892682.258816:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789892682.258830:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055562112:0@lo:400:kworker.0 00010000:00080000:2.0:1789892682.258833:0:3619:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90308457dc00 x1876835055561984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892682.258838:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789892682.258840:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055561472:12345-0@lo:400:kworker.0 Request processed in 68us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892682.258852:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055560704:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789892682.258855:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055561088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258862:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1789892682.258866:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3619:1876835055561984:0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.258871:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055560576:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892682.258885:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055560960:0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258894:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1789892682.258906:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055561600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892682.258928:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b09fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055561472:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258932:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055561088:12345-0@lo:400:kworker.0 Request processed in 82us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892682.258934:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055561088:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.258951:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1789892682.258969:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309e3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055561600:12345-0@lo:400:kworker.0 Request processed in 65us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892682.258969:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055561600:0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.258985:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:2.0:1789892682.259000:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789892682.259007:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789892682.259010:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789892682.259013:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789892682.259013:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892682.259043:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055561728:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.259047:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561216 00000100:00100000:3.0:1789892682.259057:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561216 00000100:00100000:0.0:1789892682.259076:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892682.259093:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055561728 00000100:00100000:3.0:1789892682.259096:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055561728 00000100:00100000:0.0:1789892682.259111:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055562240:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.259124:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1789892682.259133:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1789892682.259135:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055561216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.259143:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892682.259154:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876835055561728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892682.259155:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562240 00000100:00100000:1.0:1789892682.259164:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562240 00000100:00100000:0.0:1789892682.259184:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082133800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055560320:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.259185:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba324e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055561216:12345-0@lo:400:kworker.0 Request processed in 52us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892682.259199:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 508 00000100:00100000:2.0:1789892682.259211:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba324a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876835055561728:12345-0@lo:400:kworker.0 Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892682.259213:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055560448:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892682.259220:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 509 00000100:00100000:3.0:1789892682.259227:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 510 00000100:00100000:3.0:1789892682.259240:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055562240:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789892682.259248:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892682.259252:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031bfb0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055561216:0@lo:400:kworker.0 00000100:00100000:0.0:1789892682.259271:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055561728:0@lo:400:kworker.0 00000100:00100000:3.0:1789892682.259287:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba326d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055562240:12345-0@lo:400:kworker.0 Request processed in 51us (143us total) trans 0 rc 0/0 00010000:00080000:0.0:1789892682.259293:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90308457d500 x1876835055562240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892682.259297:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 510 00000100:00100000:0.0:1789892682.259311:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055562240:0@lo:400:kworker.0 00010000:00010000:3.0:1789892682.833855:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892683.025739:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892683.025748:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 187 10000000:01000000:2.0:1789892683.025753:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892683.025812:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.025823:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.025833:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.025861:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055562368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.025955:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.026001:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.026057:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562368 00000100:00100000:0.0:1789892683.026067:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562368 00000100:00100000:0.0:1789892683.026139:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2410 00000100:00100000:0.0:1789892683.026150:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055562368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892683.026166:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892683.026181:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af858 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.026207:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.026235:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 16 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.026244:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98200, rc 0) 00000100:00100000:0.0:1789892683.026300:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055562368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.026306:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2410 00000100:00100000:2.0:1789892683.026344:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055562368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.026361:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.026370:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.026429:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055562496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.026452:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.026476:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.026498:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562496 00000100:00100000:0.0:1789892683.026503:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562496 00000100:00100000:0.0:1789892683.026526:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2411 00000100:00100000:0.0:1789892683.026531:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055562496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.026653:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055562496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 122us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.026661:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2411 00000100:00100000:2.0:1789892683.026699:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055562496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.026729:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055562624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.026774:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.026805:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562624 00000100:00100000:2.0:1789892683.026807:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.026810:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562624 00000100:00100000:0.0:1789892683.026842:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2412 00000100:00100000:0.0:1789892683.026849:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055562624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.026946:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055562624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 98us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.026953:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2412 00000100:00100000:2.0:1789892683.026973:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055562624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.027330:0:217560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217560:1876835055562752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892683.027358:0:217560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.027372:0:217560:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.027411:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562752 00000100:00100000:1.0:1789892683.027418:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562752 00000100:00100000:1.0:1789892683.027458:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2413 00000100:00100000:1.0:1789892683.027476:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217560:x1876835055562752:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.027612:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217560:x1876835055562752:12345-0@lo:502:llog_process_th.0 Request processed in 137us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.027622:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2413 00000100:00100000:2.0:1789892683.027626:0:217560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217560:1876835055562752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892683.027667:0:217560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217560:1876835055562880:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892683.027722:0:217560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.027739:0:217560:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.027768:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055562880 00000100:00100000:1.0:1789892683.027775:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055562880 00000100:00100000:1.0:1789892683.027806:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2414 00000100:00100000:1.0:1789892683.027814:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217560:x1876835055562880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.027898:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:217560:x1876835055562880:12345-0@lo:502:llog_process_th.0 Request processed in 84us (174us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.027921:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2414 00000100:00100000:2.0:1789892683.027928:0:217560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217560:1876835055562880:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892683.027959:0:217560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:3.0:1789892683.028046:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:3.0:1789892683.028067:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892683.028075:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892683.028083:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892683.028091:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892683.028092:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892683.028094:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892683.028110:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892683.028116:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892683.028128:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892683.028140:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892683.028167:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892683.028187:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903191d30840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.028241:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563008 00000100:00100000:0.0:1789892683.028247:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563008 00000100:00100000:0.0:1789892683.028273:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2415 00000100:00100000:0.0:1789892683.028279:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055563008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892683.028294:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892683.028302:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af866 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.028316:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.028323:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.028329:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892683.028362:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055563008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.028368:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2415 00000100:00100000:3.0:1789892683.028387:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892683.028398:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892683.028404:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892683.028438:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892683.028457:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892683.028471:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903191d30840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.028492:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563136 00000100:00100000:0.0:1789892683.028496:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563136 00000100:00100000:0.0:1789892683.028517:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2416 00000100:00100000:0.0:1789892683.028521:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055563136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.028588:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055563136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.028593:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2416 00000100:00100000:3.0:1789892683.028613:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892683.028637:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892683.028665:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892683.028705:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903191d30840 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.028713:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563264 00000100:00100000:1.0:1789892683.028720:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563264 00000100:00100000:1.0:1789892683.028755:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2417 00000100:00100000:1.0:1789892683.028764:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055563264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.028852:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055563264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.028861:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2417 00000100:00100000:3.0:1789892683.028871:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789892683.029462:0:217561:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 38 00000020:01000000:2.0:1789892683.029526:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-37 (rc=0) 10000000:01000000:2.0:1789892683.029544:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892683.029549:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.029556:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.029562:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892683.029563:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 187 10000000:01000000:2.0:1789892683.029570:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892683.029582:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.029588:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.029594:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.029602:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.029623:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.029636:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.029668:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563392 00000100:00100000:1.0:1789892683.029674:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563392 00000100:00100000:1.0:1789892683.029733:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2418 00000100:00100000:1.0:1789892683.029741:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055563392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892683.029750:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892683.029760:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af874 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.029791:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.029801:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 18 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.029810:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6600, rc 0) 00000100:00100000:1.0:1789892683.029849:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055563392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.029858:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2418 00000100:00100000:2.0:1789892683.029866:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.029878:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.029884:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.029935:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.029955:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.029972:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.030000:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563520 00000100:00100000:0.0:1789892683.030007:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563520 00000100:00100000:0.0:1789892683.030040:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2419 00000100:00100000:0.0:1789892683.030048:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055563520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.030132:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055563520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 82us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.030142:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.030157:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2419 00000100:00100000:2.0:1789892683.030165:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.030198:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.030210:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.030227:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563648 00000100:00100000:0.0:1789892683.030233:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563648 00000100:00100000:0.0:1789892683.030261:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2420 00000100:00100000:0.0:1789892683.030268:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055563648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.030347:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055563648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.030357:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2420 00000100:00100000:2.0:1789892683.030363:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055563648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.030561:0:217562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217562:1876835055563776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.030602:0:217562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.030625:0:217562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031812549c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.030649:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563776 00000100:00100000:1.0:1789892683.030655:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563776 00000100:00100000:0.0:1789892683.030706:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2421 00000100:00100000:0.0:1789892683.030717:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217562:x1876835055563776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.030811:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217562:x1876835055563776:12345-0@lo:502:llog_process_th.0 Request processed in 95us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.030820:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2421 00000100:00100000:3.0:1789892683.030823:0:217562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217562:1876835055563776:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892683.030861:0:217562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217562:1876835055563904:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892683.030892:0:217562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892683.030921:0:217562:0:(client.c:2702:ptlrpc_set_wait()) set ffff903191d30d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.030943:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055563904 00000100:00100000:1.0:1789892683.030949:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055563904 00000100:00100000:1.0:1789892683.030976:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2422 00000100:00100000:1.0:1789892683.030983:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217562:x1876835055563904:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.031061:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:217562:x1876835055563904:12345-0@lo:502:llog_process_th.0 Request processed in 77us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.031071:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2422 00000100:00100000:3.0:1789892683.031076:0:217562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217562:1876835055563904:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789892683.031097:0:217562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:2.0:1789892683.031150:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:2.0:1789892683.031168:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892683.031172:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.031177:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.031183:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892683.031185:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:2.0:1789892683.031187:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892683.031198:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.031204:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.031209:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.031217:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.031237:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.031251:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.031284:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564032 00000100:00100000:1.0:1789892683.031289:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564032 00000100:00100000:1.0:1789892683.031315:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2423 00000100:00100000:1.0:1789892683.031322:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055564032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892683.031331:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892683.031340:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af882 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.031369:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.031380:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 19 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.031389:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7e00, rc 0) 00000100:00100000:1.0:1789892683.031424:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055564032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.031432:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2423 00000100:00100000:2.0:1789892683.031452:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.031466:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.031476:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.031509:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.031528:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.031542:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.031565:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564160 00000100:00100000:0.0:1789892683.031570:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564160 00000100:00100000:0.0:1789892683.031592:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2424 00000100:00100000:0.0:1789892683.031599:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055564160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.031673:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055564160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.031693:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.031716:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.031720:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2424 00000100:00100000:2.0:1789892683.031754:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.031780:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564288 00000100:00100000:2.0:1789892683.031783:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.031785:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564288 00000100:00100000:0.0:1789892683.031819:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2425 00000100:00100000:0.0:1789892683.031826:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055564288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.031886:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055564288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 61us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.031893:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2425 00000100:00100000:2.0:1789892683.031923:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892683.032509:0:217563:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 41 00000020:01000000:2.0:1789892683.032577:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-40 (rc=0) 10000000:01000000:2.0:1789892683.032594:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789892683.032601:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.032610:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.032619:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892683.032621:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 187 10000000:01000000:2.0:1789892683.032624:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892683.032639:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.032648:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.032656:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.032706:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.032741:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.032767:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.032793:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564416 00000100:00100000:1.0:1789892683.032800:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564416 00000100:00100000:1.0:1789892683.032828:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2426 00000100:00100000:1.0:1789892683.032838:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055564416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892683.032846:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892683.032855:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af890 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.032872:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.032882:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 20 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.032891:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6e00, rc 0) 00000100:00100000:1.0:1789892683.032940:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055564416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.032960:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2426 00000100:00100000:2.0:1789892683.032967:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.032978:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.032985:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.033013:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.033032:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.033045:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.033060:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564544 00000100:00100000:1.0:1789892683.033065:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564544 00000100:00100000:1.0:1789892683.033095:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2427 00000100:00100000:1.0:1789892683.033103:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055564544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.033178:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055564544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.033185:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.033191:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2427 00000100:00100000:2.0:1789892683.033207:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.033237:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.033251:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309180 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.033262:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564672 00000100:00100000:0.0:1789892683.033268:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564672 00000100:00100000:0.0:1789892683.033291:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2428 00000100:00100000:0.0:1789892683.033297:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055564672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.033356:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055564672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.033362:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2428 00000100:00100000:2.0:1789892683.033371:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055564672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.033535:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217564:1876835055564800:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.033564:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.033581:0:217564:0:(client.c:2702:ptlrpc_set_wait()) set ffff903092bb1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892683.033584:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564800 00000100:00100000:2.0:1789892683.033589:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564800 00000100:00100000:2.0:1789892683.033612:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2429 00000100:00100000:2.0:1789892683.033618:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217564:x1876835055564800:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.033744:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217564:1876835055564800:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892683.033749:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217564:x1876835055564800:12345-0@lo:502:llog_process_th.0 Request processed in 129us (181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.033762:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2429 00000100:00100000:0.0:1789892683.033779:0:217564:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217564:1876835055564928:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.033817:0:217564:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892683.033855:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055564928 00000100:00100000:0.0:1789892683.033856:0:217564:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319c9e13c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.033861:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055564928 00000100:00100000:1.0:1789892683.033893:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2430 00000100:00100000:1.0:1789892683.033903:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217564:x1876835055564928:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.033997:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:217564:x1876835055564928:12345-0@lo:502:llog_process_th.0 Request processed in 95us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.034004:0:217564:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217564:1876835055564928:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.034010:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2430 00000040:00080000:0.0:1789892683.034025:0:217564:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:2.0:1789892683.034066:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:2.0:1789892683.034085:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892683.034090:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.034096:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.034103:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892683.034104:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 212 10000000:01000000:2.0:1789892683.034106:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892683.034117:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.034123:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.034128:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.034136:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.034156:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.034169:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.034200:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565056 00000100:00100000:1.0:1789892683.034206:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565056 00000100:00100000:1.0:1789892683.034234:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2431 00000100:00100000:1.0:1789892683.034242:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055565056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892683.034250:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892683.034259:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af89e expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.034276:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.034286:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 21 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.034301:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6200, rc 0) 00000100:00100000:1.0:1789892683.034335:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055565056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.034343:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2431 00000100:00100000:2.0:1789892683.034349:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.034360:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.034381:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.034419:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.034447:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.034466:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.034477:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565184 00000100:00100000:0.0:1789892683.034481:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565184 00000100:00100000:0.0:1789892683.034501:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2432 00000100:00100000:0.0:1789892683.034514:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055565184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.034571:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055565184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 58us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.034576:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2432 00000100:00100000:2.0:1789892683.034596:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.034622:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.034652:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.034666:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.034671:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565312 00000100:00100000:0.0:1789892683.034675:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565312 00000100:00100000:0.0:1789892683.034737:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2433 00000100:00100000:0.0:1789892683.034742:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055565312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.034802:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055565312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 59us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.034808:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2433 00000100:00100000:2.0:1789892683.034814:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.035012:0:217565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217565:1876835055565440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.035040:0:217565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.035060:0:217565:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319ca33cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.035082:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565440 00000100:00100000:1.0:1789892683.035088:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565440 00000100:00100000:1.0:1789892683.035116:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2434 00000100:00100000:1.0:1789892683.035124:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217565:x1876835055565440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.035216:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217565:x1876835055565440:12345-0@lo:502:llog_process_th.0 Request processed in 92us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.035219:0:217565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217565:1876835055565440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.035235:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2434 00000020:01000000:0.0:1789892683.035246:0:217565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892683.035256:0:217565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892683.035258:0:217565:0:(obd_config.c:1561:class_process_config()) marker 200 (0x1) lustre-MDT0001-m del lustre.qpool2 00000020:00000080:0.0:1789892683.035264:0:217565:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892683.035336:0:217565:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217565:1876835055565568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.035363:0:217565:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.035377:0:217565:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cc973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.035394:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565568 00000100:00100000:1.0:1789892683.035401:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565568 00000100:00100000:1.0:1789892683.035427:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2435 00000100:00100000:1.0:1789892683.035436:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217565:x1876835055565568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.035510:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:217565:x1876835055565568:12345-0@lo:502:llog_process_th.0 Request processed in 74us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.035514:0:217565:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217565:1876835055565568:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.035525:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2435 00000020:01000000:0.0:1789892683.035536:0:217565:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892683.035541:0:217565:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892683.035546:0:217565:0:(obd_config.c:1561:class_process_config()) marker 200 (0x2) lustre-MDT0001-m del lustre.qpool2 00000040:00080000:0.0:1789892683.035550:0:217565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 215 count 211 00000020:01000000:2.0:1789892683.035597:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 212-214 (rc=0) 10000000:01000000:2.0:1789892683.035613:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1789892683.035617:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.035622:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.035628:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892683.035629:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 187 10000000:01000000:2.0:1789892683.035631:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892683.035642:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.035646:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.035657:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.035665:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.035708:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.035732:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.035732:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565696 00000100:00100000:0.0:1789892683.035738:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565696 00000100:00100000:0.0:1789892683.035761:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2436 00000100:00100000:0.0:1789892683.035767:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055565696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892683.035772:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892683.035780:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af8ac expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.035792:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.035799:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.035804:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99600, rc 0) 00000100:00100000:0.0:1789892683.035831:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055565696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.035836:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2436 00000100:00100000:2.0:1789892683.035844:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.035856:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.035862:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.035887:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.035916:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.035928:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.035935:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565824 00000100:00100000:0.0:1789892683.035939:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565824 00000100:00100000:0.0:1789892683.035959:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2437 00000100:00100000:0.0:1789892683.035965:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055565824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.036017:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055565824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.036023:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2437 00000100:00100000:2.0:1789892683.036029:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.036050:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.036077:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.036089:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.036110:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055565952 00000100:00100000:1.0:1789892683.036116:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055565952 00000100:00100000:1.0:1789892683.036145:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2438 00000100:00100000:1.0:1789892683.036154:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055565952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.036229:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055565952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.036239:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2438 00000100:00100000:2.0:1789892683.036247:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055565952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.036473:0:217566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217566:1876835055566080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.036512:0:217566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.036533:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566080 00000100:00100000:1.0:1789892683.036533:0:217566:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789892683.036537:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566080 00000100:00100000:2.0:1789892683.036562:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2439 00000100:00100000:2.0:1789892683.036567:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217566:x1876835055566080:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892683.036629:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217566:x1876835055566080:12345-0@lo:502:llog_process_th.0 Request processed in 61us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.036635:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2439 00000100:00100000:1.0:1789892683.036660:0:217566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217566:1876835055566080:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.036719:0:217566:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217566:1876835055566208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.036757:0:217566:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.036778:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566208 00000100:00100000:0.0:1789892683.036783:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566208 00000100:00100000:1.0:1789892683.036786:0:217566:0:(client.c:2702:ptlrpc_set_wait()) set ffff903186a3dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.036813:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2440 00000100:00100000:0.0:1789892683.036818:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217566:x1876835055566208:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.036874:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:217566:x1876835055566208:12345-0@lo:502:llog_process_th.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.036882:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2440 00000100:00100000:1.0:1789892683.036897:0:217566:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217566:1876835055566208:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892683.036934:0:217566:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 190 count 186 00000020:01000000:2.0:1789892683.036995:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 187-189 (rc=0) 10000000:01000000:2.0:1789892683.037010:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892683.037015:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.037021:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.037026:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789892683.037028:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 212 10000000:01000000:2.0:1789892683.037029:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892683.037041:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.037045:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.037050:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.037059:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.037078:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.037090:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.037100:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566336 00000100:00100000:0.0:1789892683.037104:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566336 00000100:00100000:0.0:1789892683.037124:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2441 00000100:00100000:0.0:1789892683.037129:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055566336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892683.037134:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892683.037141:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af8ba expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.037152:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.037158:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.037163:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98800, rc 0) 00000100:00100000:0.0:1789892683.037187:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055566336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 57us (108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.037192:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2441 00000100:00100000:2.0:1789892683.037209:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892683.037220:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.037231:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.037257:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.037277:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.037294:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.037313:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566464 00000100:00100000:1.0:1789892683.037319:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566464 00000100:00100000:1.0:1789892683.037350:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2442 00000100:00100000:1.0:1789892683.037359:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055566464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.037435:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055566464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 77us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.037446:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2442 00000100:00100000:2.0:1789892683.037458:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.037480:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.037507:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.037520:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309480 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.037532:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566592 00000100:00100000:1.0:1789892683.037538:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566592 00000100:00100000:1.0:1789892683.037565:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2443 00000100:00100000:1.0:1789892683.037574:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055566592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.037650:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055566592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.037658:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.037660:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2443 00000100:00100000:0.0:1789892683.037840:0:217567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217567:1876835055566720:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.037869:0:217567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.037890:0:217567:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.037903:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566720 00000100:00100000:1.0:1789892683.037923:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566720 00000100:00100000:1.0:1789892683.037956:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2444 00000100:00100000:1.0:1789892683.037964:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217567:x1876835055566720:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.038044:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217567:x1876835055566720:12345-0@lo:502:llog_process_th.0 Request processed in 80us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.038052:0:217567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217567:1876835055566720:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892683.038055:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2444 00000020:01000000:0.0:1789892683.038083:0:217567:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892683.038088:0:217567:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892683.038090:0:217567:0:(obd_config.c:1561:class_process_config()) marker 199 (0x1) lustre-MDT0000-m del lustre.qpool2 00000020:00000080:0.0:1789892683.038093:0:217567:0:(obd_config.c:1470:class_process_config()) processing cmd: ce023 00000100:00100000:0.0:1789892683.038616:0:217567:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217567:1876835055566848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892683.038642:0:217567:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.038659:0:217567:0:(client.c:2702:ptlrpc_set_wait()) set ffff903082182b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892683.038674:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566848 00000100:00100000:2.0:1789892683.038695:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566848 00000100:00100000:2.0:1789892683.038728:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2445 00000100:00100000:2.0:1789892683.038736:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217567:x1876835055566848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892683.038796:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:217567:x1876835055566848:12345-0@lo:502:llog_process_th.0 Request processed in 62us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.038802:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2445 00000100:00100000:0.0:1789892683.038813:0:217567:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:217567:1876835055566848:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892683.038832:0:217567:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892683.038836:0:217567:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892683.038837:0:217567:0:(obd_config.c:1561:class_process_config()) marker 199 (0x2) lustre-MDT0000-m del lustre.qpool2 00000040:00080000:0.0:1789892683.038839:0:217567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 215 count 211 00000020:01000000:2.0:1789892683.038871:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 212-214 (rc=0) 10000000:01000000:2.0:1789892683.038889:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892683.038894:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.038901:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892683.038923:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892683.038925:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:2.0:1789892683.038927:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892683.038937:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.038943:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.038948:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.038956:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.038974:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.038994:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892683.038997:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055566976 00000100:00100000:0.0:1789892683.039001:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055566976 00000100:00100000:0.0:1789892683.039025:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2446 00000100:00100000:0.0:1789892683.039029:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055566976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892683.039035:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892683.039042:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af8c8 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.039053:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.039059:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 24 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.039064:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99000, rc 0) 00000100:00100000:0.0:1789892683.039093:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055566976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 63us (117us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.039103:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055566976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.039106:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2446 00010000:00010000:2.0:1789892683.039115:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.039123:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.039149:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055567104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.039167:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892683.039180:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903085309e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789892683.039201:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567104 00000100:00100000:1.0:1789892683.039207:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567104 00000100:00100000:1.0:1789892683.039239:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2447 00000100:00100000:1.0:1789892683.039249:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055567104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.039309:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055567104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 61us (137us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892683.039318:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2447 00000100:00100000:2.0:1789892683.039320:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055567104:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892683.039352:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892683.039356:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892683.039361:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892683.771799:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892683.771850:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748032 00000100:00100000:1.0:1789892683.771863:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748032 00000100:00100000:1.0:1789892683.771938:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2448 00000100:00100000:1.0:1789892683.771950:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062748032:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892683.771972:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892683.771994:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26041d expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.772025:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.772035:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892683.772044:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7a00, rc 0) 00000100:00100000:1.0:1789892683.772130:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062748032:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 183us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.772137:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2448 00000100:00100000:0.0:1789892683.773044:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892683.773098:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748160 00000100:00100000:2.0:1789892683.773105:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748160 00000100:00100000:2.0:1789892683.773142:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2449 00000100:00100000:2.0:1789892683.773153:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062748160:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892683.773313:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062748160:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 162us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892683.773323:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2449 00000100:00100000:2.0:1789892683.773974:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892683.774028:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748288 00000100:00100000:0.0:1789892683.774033:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748288 00000100:00100000:0.0:1789892683.774070:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2450 00000100:00100000:0.0:1789892683.774077:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062748288:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892683.774166:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062748288:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 89us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.774171:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2450 00000100:00100000:0.0:1789892683.775186:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892683.775260:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748416 00000100:00100000:1.0:1789892683.775266:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748416 00000100:00100000:1.0:1789892683.775294:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2451 00000100:00100000:1.0:1789892683.775300:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216252:x1876835062748416:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892683.775388:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216252:x1876835062748416:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.775395:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2451 00000100:00100000:2.0:1789892683.776126:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892683.776174:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748544 00000100:00100000:1.0:1789892683.776180:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748544 00000100:00100000:1.0:1789892683.776219:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2452 00000100:00100000:1.0:1789892683.776227:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216252:x1876835062748544:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789892683.776301:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:216252:x1876835062748544:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 73us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892683.776310:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2452 00000100:00100000:2.0:1789892683.777226:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892683.777258:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748672 00000100:00100000:0.0:1789892683.777264:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748672 00000100:00100000:0.0:1789892683.777306:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2453 00000100:00100000:0.0:1789892683.777317:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062748672:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892683.777326:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892683.777334:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260424 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.777348:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.777355:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 10 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892683.777361:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892683.777386:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062748672:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 73us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.777398:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2453 00000100:00100000:0.0:1789892683.778076:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892683.778119:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748800 00000100:00100000:1.0:1789892683.778123:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748800 00000100:00100000:1.0:1789892683.778147:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2454 00000100:00100000:1.0:1789892683.778152:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062748800:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892683.778199:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062748800:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 47us (125us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789892683.778209:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2454 00000100:00100000:3.0:1789892683.793869:0:3619:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789892683.793891:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055567232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789892683.793957:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892683.794006:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567232 00000100:00100000:0.0:1789892683.794014:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567232 00000100:00100000:0.0:1789892683.794052:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1789892683.794058:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055567232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789892683.794086:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892683.794133:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055567232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892683.794140:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789892683.794177:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba325c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055567232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789892683.857796:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892684.207949:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892684.208014:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062748928 00000100:00100000:3.0:1789892684.208028:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062748928 00000100:00080000:1.0:1789892684.208081:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892684.208117:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2799 00000100:00100000:3.0:1789892684.208130:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216280:x1876835062748928:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:3.0:1789892684.208155:0:197539:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892684.208177:0:197539:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af8e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26042b expref: -99 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208242:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208255:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208266:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208285:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208301:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208306:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208389:0:197539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c400/0xd5b980e0d62af8f9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208395:0:197539:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c400/0xd5b980e0d62af8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208400:0:197539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c400/0xd5b980e0d62af8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789892684.208440:0:197539:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00000004:00200000:3.0:1789892684.208443:0:197539:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789892684.208462:0:197539:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c400/0xd5b980e0d62af8f9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208473:0:197539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208478:0:197539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208484:0:197539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208488:0:197539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ce00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:3.0:1789892684.208491:0:197539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208503:0:197539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208514:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903083213300) 00010000:00010000:3.0:1789892684.208517:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892684.208520:0:197539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208525:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af8eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208534:0:197539:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208538:0:197539:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208543:0:197539:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208546:0:197539:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d600 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:3.0:1789892684.208548:0:197539:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208552:0:197539:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208556:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff903091441600) 00010000:00010000:3.0:1789892684.208557:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892684.208559:0:197539:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208566:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af8f2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 197539 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208593:0:197539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af8e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26042b expref: 8 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208603:0:197539:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c400/0xd5b980e0d62af8f9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26042b expref: 7 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.208609:0:197539:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903091441000) 00010000:00010000:3.0:1789892684.208611:0:197539:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789892684.208613:0:197539:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c400, rc 0) 00000100:00100000:3.0:1789892684.208671:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+7:216280:x1876835062748928:12345-192.168.203.53@tcp:101:rm.0 Request processed in 544us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892684.208698:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2799 00000100:00100000:2.0:1789892684.210131:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892684.210173:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062749184 00000100:00100000:0.0:1789892684.210180:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062749184 00000100:00100000:0.0:1789892684.210219:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2800 00000100:00100000:0.0:1789892684.210231:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+7:216280:x1876835062749184:12345-192.168.203.53@tcp:101:rm.0 00010000:00010000:0.0:1789892684.210242:0:192563:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892684.210253:0:192563:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99a00/0xd5b980e0d62af900 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260432 expref: -99 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892684.210314:0:192563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:0.0:1789892684.210423:0:192563:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99a00/0xd5b980e0d62af900 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260432 expref: 9 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892684.210436:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903083213300) 00010000:00010000:0.0:1789892684.210439:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789892684.210443:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99a00/0xd5b980e0d62af900 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260432 expref: 9 pid: 192563 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892684.210466:0:192563:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99a00, rc 0) 00000100:00100000:0.0:1789892684.210502:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+8:216280:x1876835062749184:12345-192.168.203.53@tcp:101:rm.0 Request processed in 274us (371us total) trans 12884904338 rc 301/301 00000100:00100000:0.0:1789892684.210511:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2800 00000100:00100000:0.0:1789892684.212059:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892684.212098:0:193007:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062749312 00000100:00100000:2.0:1789892684.212103:0:193007:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062749312 00000100:00100000:2.0:1789892684.212135:0:193007:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 196 00000100:00100000:2.0:1789892684.212142:0:193007:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903085c1f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+8:216280:x1876835062749312:12345-192.168.203.53@tcp:37:rm.0 00000100:00100000:0.0:1789892684.214029:0:193007:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903085c1f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+8:216280:x1876835062749312:12345-192.168.203.53@tcp:37:rm.0 Request processed in 1886us (1970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892684.214039:0:193007:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 196 00000100:00100000:1.0:1789892684.215376:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892684.215415:0:190672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062749568 00000100:00100000:2.0:1789892684.215421:0:190672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062749568 00000100:00100000:2.0:1789892684.215451:0:190672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 197 00000100:00100000:2.0:1789892684.215465:0:190672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+8:216280:x1876835062749568:12345-192.168.203.53@tcp:35:rm.0 00000100:00100000:2.0:1789892684.215568:0:190672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+9:216280:x1876835062749568:12345-192.168.203.53@tcp:35:rm.0 Request processed in 104us (194us total) trans 12884904339 rc 0/0 00000100:00100000:2.0:1789892684.215574:0:190672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 197 00000100:00100000:2.0:1789892684.216568:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892684.216612:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062749824 00000100:00100000:3.0:1789892684.216617:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062749824 00000100:00100000:3.0:1789892684.216646:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2801 00000100:00100000:3.0:1789892684.216655:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+9:216280:x1876835062749824:12345-192.168.203.53@tcp:36:rm.0 00010000:00010000:3.0:1789892684.216712:0:192197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1789892684.216730:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c400/0xd5b980e0d62af8f9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x82:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26042b expref: 9 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216745:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903091441000) 00010000:00010000:3.0:1789892684.216756:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9c000/0xd5b980e0d62af2f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260391 expref: 8 pid: 197539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216773:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903083213300) 00010000:00010000:3.0:1789892684.216778:0:192197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892684.216790:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216797:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216803:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216810:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216816:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216820:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216862:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216868:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.216873:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789892684.217058:0:192197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x82:0x0]: returning size 4096 00010000:00010000:3.0:1789892684.217067:0:192197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217077:0:192197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217082:0:192197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217086:0:192197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ce00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:3.0:1789892684.217089:0:192197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217093:0:192197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217099:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x82:0x0].0x0 (ffff903091441c00) 00010000:00010000:3.0:1789892684.217100:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789892684.217103:0:192197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217107:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af91c lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x82:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217119:0:192197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217124:0:192197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217128:0:192197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217131:0:192197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9de00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:3.0:1789892684.217137:0:192197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217142:0:192197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217147:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903091441600) 00010000:00010000:3.0:1789892684.217148:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789892684.217150:0:192197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217154:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9de00/0xd5b980e0d62af90e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789892684.217161:0:192197:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000d7d8101a reply state 0000000008e654be transno 12884904340 ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217170:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892684.217174:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff903091441e00) 00010000:00010000:3.0:1789892684.217175:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1789892684.217177:0:192197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789892684.217210:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+9:216280:x1876835062749824:12345-192.168.203.53@tcp:36:rm.0 Request processed in 556us (641us total) trans 12884904340 rc 0/0 00000100:00100000:3.0:1789892684.217215:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2801 00000100:00100000:0.0:1789892684.218375:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892684.218418:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062749952 00000100:00100000:1.0:1789892684.218424:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062749952 00000100:00100000:1.0:1789892684.218461:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2802 00000100:00100000:1.0:1789892684.218470:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+9:214765:x1876835062749952:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:1.0:1789892684.218482:0:190669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892684.218496:0:190669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6800/0xd5b980e0d62af923 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260439 expref: -99 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892684.218535:0:190669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6c00/0xd5b980e0d62af92a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892684.218545:0:190669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6c00/0xd5b980e0d62af92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892684.218555:0:190669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6c00/0xd5b980e0d62af92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789892684.218579:0:190669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789892684.218583:0:190669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789892684.218597:0:190669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6c00/0xd5b980e0d62af92a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892684.218614:0:190669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6800/0xd5b980e0d62af923 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260439 expref: 11 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892684.218630:0:190669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6c00/0xd5b980e0d62af92a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260439 expref: 10 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892684.218638:0:190669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:1.0:1789892684.218648:0:190669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789892684.218651:0:190669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6c00, rc 0) 00000100:00100000:1.0:1789892684.218710:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba325880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+10:214765:x1876835062749952:12345-192.168.203.53@tcp:101:bash.0 Request processed in 240us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892684.218719:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2802 00000100:00100000:1.0:1789892684.219550:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892684.219588:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750080 00000100:00100000:2.0:1789892684.219593:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750080 00000100:00100000:2.0:1789892684.219623:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2803 00000100:00100000:2.0:1789892684.219629:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+10:214765:x1876835062750080:12345-192.168.203.53@tcp:101:bash.0 00010000:00010000:2.0:1789892684.219637:0:190670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892684.219646:0:190670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382600/0xd5b980e0d62af931 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260440 expref: -99 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219676:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219709:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219721:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219736:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219745:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219750:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219776:0:190670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219781:0:190670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219785:0:190670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219788:0:190670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383c00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892684.219791:0:190670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219794:0:190670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219800:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:2.0:1789892684.219802:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892684.219805:0:190670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219809:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af938 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219816:0:190670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219820:0:190670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219825:0:190670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219836:0:190670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383e00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892684.219840:0:190670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219846:0:190670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219855:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7443287c (ffff903183df6700) 00010000:00010000:2.0:1789892684.219858:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892684.219860:0:190670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219867:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af93f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7443287c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219892:0:190670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382600/0xd5b980e0d62af931 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260440 expref: 11 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219916:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:2.0:1789892684.219918:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892684.219923:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382600/0xd5b980e0d62af931 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260440 expref: 11 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892684.219932:0:190670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382600, rc 0) 00000100:00100000:2.0:1789892684.219966:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+10:214765:x1876835062750080:12345-192.168.203.53@tcp:101:bash.0 Request processed in 336us (416us total) trans 0 rc 301/301 00000100:00100000:2.0:1789892684.219975:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2803 00000100:00100000:2.0:1789892684.475727:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892684.475781:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750336 00000100:00100000:2.0:1789892684.475789:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892684.475794:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750336 00000100:00100000:1.0:1789892684.475842:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750208 00000100:00100000:1.0:1789892684.475850:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750208 00000100:00080000:2.0:1789892684.475857:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892684.475909:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 511 00000100:00100000:1.0:1789892684.475915:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2455 00000100:00100000:3.0:1789892684.475928:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062750336:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892684.475934:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062750208:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892684.476026:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062750208:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 98us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892684.476027:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2396:x1876835062750336:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 103us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892684.476040:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2455 00000100:00100000:3.0:1789892684.476050:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 511 00010000:00010000:2.0:1789892684.882582:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789892685.334192:0:217791:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892685.334200:0:217791:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:3.0:1789892685.347217:0:217798:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789892685.347225:0:217798:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000001:00080000:2.0:1789892685.784258:0:190650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904340 is committed 00010000:00010000:1.0:1789892685.784311:0:3604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892685.784329:0:3604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892685.784340:0:3604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892685.784349:0:3604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d600 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892685.784355:0:3604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892685.784366:0:3604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892685.784402:0:3604:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x91d0d69f (ffff903091441e00) 00010000:00010000:1.0:1789892685.784406:0:3604:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892685.784413:0:3604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892685.784421:0:3604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9d600/0xd5b980e0d62af915 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x91d0d69f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892685.905896:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789892686.218494:0:217904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3376472811448ns, next at 3261060696520ns, rc = 0 00080000:00080000:3.0:1789892686.218517:0:217904:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789892686.218609:0:217904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3376472928954ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789892686.218615:0:217904:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789892686.218703:0:217904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3376473023179ns, next at 3187969760152ns, rc = 0 00080000:00080000:3.0:1789892686.218710:0:217904:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:3.0:1789892686.218773:0:217904:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3376473093408ns, next at 0ns, rc = 0 00080000:00080000:3.0:1789892686.218779:0:217904:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:2.0:1789892686.219248:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 45 committed 00000004:00080000:1.0:1789892686.219272:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 37 committed 00000004:00080000:1.0:1789892686.219823:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 37 committed 00000004:00080000:3.0:1789892686.219835:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 43 committed 00000100:00100000:2.0:1789892686.681105:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892686.681151:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750464 00000100:00100000:3.0:1789892686.681162:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750464 00000100:00080000:2.0:1789892686.681227:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892686.681250:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2804 00000100:00100000:3.0:1789892686.681264:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216604:x1876835062750464:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892686.683854:0:197539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055567360:0@lo:106: 00000100:00100000:3.0:1789892686.683933:0:197539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892686.684019:0:197539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055567488:0@lo:106: 00000100:00100000:3.0:1789892686.684048:0:197539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892686.684162:0:197539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055567616:0@lo:106: 00000100:00100000:3.0:1789892686.684194:0:197539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892686.684209:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567488 00000100:00100000:0.0:1789892686.684209:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567360 00000100:00100000:0.0:1789892686.684215:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567360 00000100:00100000:2.0:1789892686.684221:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567488 00000100:00100000:2.0:1789892686.684257:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 518 00000100:00100000:0.0:1789892686.684262:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789892686.684266:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:197539:x1876835055567488:12345-0@lo:106: 00000100:00100000:0.0:1789892686.684268:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:197539:x1876835055567360:12345-0@lo:106: 00010000:00010000:0.0:1789892686.684284:0:190654:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892686.684285:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892686.684300:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892686.684300:0:190654:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892686.684366:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:197539:x1876835055567488:12345-0@lo:106: Request processed in 101us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.684366:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:lustre-MDT0000-lwp-OST0001+8:197539:x1876835055567360:12345-0@lo:106: Request processed in 96us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.684375:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:2.0:1789892686.684378:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 518 00000100:00100000:2.0:1789892686.684458:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876835055567744:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892686.684494:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892686.684641:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055567872:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.684665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892686.684765:0:191408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567744 00000100:00100000:2.0:1789892686.684770:0:191408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567744 00000100:00100000:0.0:1789892686.684798:0:190673:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567872 00000100:00100000:0.0:1789892686.684802:0:190673:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567872 00000100:00100000:0.0:1789892686.684827:0:190673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789892686.684834:0:190673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+9:3620:x1876835055567872:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.684896:0:190673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba327b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+9:3620:x1876835055567872:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 48us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.684903:0:190673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789892686.684916:0:190673:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:0.0:1789892686.684924:0:190673:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876835055567744:12345-0@lo:601:lquota_wb_lustr.0 00000100:00080000:2.0:1789892686.684933:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892686.684966:0:190673:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-lwp-OST0001_UUID+8:3619:x1876835055567744:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 43us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.684972:0:190673:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1789892686.684996:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba326300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3619:1876835055567744:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.684998:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055567872:0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892686.685095:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055567616 00000100:00100000:2.0:1789892686.685099:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055567616 00000100:00100000:3.0:1789892686.685116:0:197539:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055568000:0@lo:106: 00000100:00100000:2.0:1789892686.685132:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:2.0:1789892686.685149:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0001+9:197539:x1876835055567616:12345-0@lo:106: 00000100:00100000:3.0:1789892686.685150:0:197539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892686.685159:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892686.685169:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892686.685173:0:197539:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cb51b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892686.685204:0:197539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055567360:0@lo:106: 00000100:00100000:3.0:1789892686.685223:0:197539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055567488:0@lo:106: 00000100:00100000:2.0:1789892686.685227:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0001+9:197539:x1876835055567616:12345-0@lo:106: Request processed in 81us (1032us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892686.685234:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1789892686.685237:0:197539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055567616:0@lo:106: 00000100:00100000:2.0:1789892686.685248:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568000 00000100:00100000:2.0:1789892686.685251:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568000 00000100:00100000:2.0:1789892686.685278:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:2.0:1789892686.685286:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:197539:x1876835055568000:12345-0@lo:106: 00010000:00010000:2.0:1789892686.685295:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892686.685303:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892686.685349:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:197539:x1876835055568000:12345-0@lo:106: Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892686.685356:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1789892686.685404:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055568128:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.685440:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892686.685467:0:190672:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568128 00000100:00100000:2.0:1789892686.685474:0:190672:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568128 00000100:00100000:0.0:1789892686.685480:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055568256:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.685512:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892686.685516:0:190672:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789892686.685529:0:190672:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+8:3621:x1876835055568128:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.685550:0:194988:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568256 00000100:00100000:0.0:1789892686.685555:0:194988:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568256 00000100:00100000:2.0:1789892686.685583:0:190672:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba324380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-lwp-OST0000_UUID+9:3621:x1876835055568128:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 57us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.685584:0:194988:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 201 00000100:00100000:0.0:1789892686.685596:0:194988:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-OST0000_UUID+9:3618:x1876835055568256:12345-0@lo:601:lquota_wb_lustr.0 00000100:00100000:2.0:1789892686.685606:0:190672:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00080000:2.0:1789892686.685629:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892686.685645:0:194988:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba325180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_004:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055568256:12345-0@lo:601:lquota_wb_lustr.0 Request processed in 54us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.685652:0:194988:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 201 00000100:00100000:3.0:1789892686.685655:0:197539:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9180 pname:cluuid:pid:xid:nid:opc:job mdt00_005:lustre-MDT0000_UUID:197539:1876835055568000:0@lo:106: 00000100:00100000:0.0:1789892686.685717:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba326680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055568256:0@lo:601:lquota_wb_lustr.0 00000100:00100000:0.0:1789892686.685755:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3621:1876835055568128:0@lo:601:lquota_wb_lustr.0 00000100:00100000:3.0:1789892686.685775:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216604:x1876835062750464:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 4511us (4674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892686.685785:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2804 00000100:00100000:1.0:1789892686.701719:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892686.701787:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750592 00000100:00100000:3.0:1789892686.701801:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750592 00000100:00100000:3.0:1789892686.701869:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2805 00000100:00100000:3.0:1789892686.701894:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216607:x1876835062750592:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892686.703390:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216607:x1876835062750592:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1511us (1678us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892686.703400:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2805 00000100:00100000:2.0:1789892686.721836:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892686.721907:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750720 00000100:00100000:3.0:1789892686.721918:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750720 00000100:00100000:3.0:1789892686.721981:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2806 00000100:00100000:3.0:1789892686.721994:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216610:x1876835062750720:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892686.723994:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216610:x1876835062750720:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2001us (2164us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892686.724002:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2806 00000100:00100000:0.0:1789892686.738204:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892686.738260:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750848 00000100:00100000:1.0:1789892686.738273:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750848 00000100:00100000:1.0:1789892686.738336:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2807 00000100:00100000:1.0:1789892686.738350:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216613:x1876835062750848:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:1.0:1789892686.740094:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba327480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216613:x1876835062750848:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1746us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892686.740104:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2807 00000100:00100000:1.0:1789892686.754372:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892686.754468:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062750976 00000100:00100000:0.0:1789892686.754483:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062750976 00000100:00100000:0.0:1789892686.754555:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2808 00000100:00100000:0.0:1789892686.754570:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216616:x1876835062750976:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:0.0:1789892686.756233:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216616:x1876835062750976:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1666us (1869us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892686.756244:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2808 00000100:00100000:2.0:1789892686.762493:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892686.762537:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062751104 00000100:00100000:3.0:1789892686.762545:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062751104 00000100:00100000:3.0:1789892686.762582:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2809 00000100:00100000:3.0:1789892686.762591:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216617:x1876835062751104:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892686.763932:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216617:x1876835062751104:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1342us (1443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892686.763939:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2809 00000100:00100000:2.0:1789892686.769768:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892686.769810:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062751232 00000100:00100000:3.0:1789892686.769816:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062751232 00000100:00100000:3.0:1789892686.769847:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2810 00000100:00100000:3.0:1789892686.769853:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216618:x1876835062751232:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892686.771237:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216618:x1876835062751232:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1378us (1468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892686.771245:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2810 00000100:00100000:1.0:1789892686.776642:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892686.776702:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062751360 00000100:00100000:3.0:1789892686.776708:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062751360 00000100:00100000:3.0:1789892686.776738:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2811 00000100:00100000:3.0:1789892686.776745:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216619:x1876835062751360:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:3.0:1789892686.778161:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216619:x1876835062751360:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 1414us (1522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892686.778169:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2811 00000100:00100000:0.0:1789892686.865930:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055568384:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892686.866038:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892686.866086:0:190675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568384 00000100:00100000:2.0:1789892686.866097:0:190675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568384 00000100:00100000:2.0:1789892686.866167:0:190675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1789892686.866177:0:190675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055568384:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892686.866222:0:190675:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892686.866292:0:190675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba326680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055568384:12345-0@lo:41:osp-pre-1-0.0 Request processed in 115us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892686.866299:0:190675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789892686.866338:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055568384:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892686.929869:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892687.377894:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055568896:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892687.377909:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055569152:0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.377924:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055568768:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892687.377981:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055568640:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892687.378018:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892687.378019:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892687.378020:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892687.378066:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892687.378076:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055569024:0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.378077:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055569408:0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.378079:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055569664:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.378104:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055568512:0@lo:400:kworker.0 00000100:00100000:0.0:1789892687.378136:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892687.378139:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892687.378154:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892687.378158:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568896 00000100:00100000:2.0:1789892687.378169:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568896 00000100:00100000:1.0:1789892687.378187:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055569920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892687.378197:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055569536:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.378206:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055569280:0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.378225:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892687.378235:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569408 00000100:00100000:0.0:1789892687.378244:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892687.378252:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569408 00000100:00100000:3.0:1789892687.378256:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892687.378284:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055570048:0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.378285:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789892687.378285:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055570432:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.378291:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876835055569792:0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.378304:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055568896:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892687.378335:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892687.378345:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568768 00000100:00100000:1.0:1789892687.378352:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568768 00000004:00000024:2.0:1789892687.378354:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445875712 avail 1299636224 00000100:00100000:3.0:1789892687.378358:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569152 00000100:00100000:3.0:1789892687.378365:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569152 00000100:00100000:0.0:1789892687.378383:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789892687.378395:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876835055570176:0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.378399:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568640 00000100:00100000:1.0:1789892687.378405:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568640 00000100:00100000:2.0:1789892687.378417:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba324700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055568896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892687.378425:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569024 00000100:00100000:2.0:1789892687.378427:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789892687.378432:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569024 00000100:00100000:1.0:1789892687.378436:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569920 00000100:00100000:1.0:1789892687.378442:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569920 00000100:00100000:0.0:1789892687.378450:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892687.378469:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789892687.378474:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789892687.378478:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569536 00000100:00100000:3.0:1789892687.378484:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569536 00000100:00100000:2.0:1789892687.378485:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055569408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.378488:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055568768:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892687.378509:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1789892687.378517:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055568896:0@lo:41:osp-pre-0-1.0 00002000:00000024:1.0:1789892687.378521:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892687.378526:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1876835055569152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.378535:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055569408:12345-0@lo:400:kworker.0 Request processed in 53us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.378544:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1789892687.378572:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1789892687.378579:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd85880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3621:x1876835055568768:12345-0@lo:13:osp-pre-0-1.0 Request processed in 94us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.378582:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1789892687.378589:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055569024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.378591:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3619:x1876835055569152:12345-0@lo:400:kworker.0 Request processed in 69us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892687.378598:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789892687.378600:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3618:x1876835055569536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.378612:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:1.0:1789892687.378628:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789892687.378642:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055568640:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892687.378645:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569280 00000100:00100000:3.0:1789892687.378651:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569280 00000100:00100000:0.0:1789892687.378664:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba326a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055569024:12345-0@lo:400:kworker.0 Request processed in 80us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.378666:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba325f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055569536:12345-0@lo:400:kworker.0 Request processed in 71us (422us total) trans 0 rc 0/0 00002000:00000024:1.0:1789892687.378666:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892687.378709:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055570048 00000100:00100000:0.0:1789892687.378710:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1789892687.378716:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055570048 00000100:00100000:2.0:1789892687.378721:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789892687.378745:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055568640:12345-0@lo:13:osp-pre-1-1.0 Request processed in 107us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892687.378749:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055568512 00000100:00100000:3.0:1789892687.378754:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055570176 00000100:00100000:1.0:1789892687.378756:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789892687.378757:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055568512 00000100:00100000:3.0:1789892687.378761:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055570176 00000100:00100000:2.0:1789892687.378783:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1789892687.378784:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789892687.378799:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055569280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.378801:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055569920:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892687.378812:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1789892687.378817:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 513 00002000:00000024:1.0:1789892687.378819:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892687.378826:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055568512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.378833:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055570048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.378857:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3620:x1876835055569280:12345-0@lo:400:kworker.0 Request processed in 62us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.378865:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 512 00000100:00100000:1.0:1789892687.378871:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055569920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892687.378896:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789892687.378906:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 514 00000100:00100000:0.0:1789892687.378913:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3620:x1876835055568512:12345-0@lo:400:kworker.0 Request processed in 88us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892687.378915:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba324000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055570048:12345-0@lo:400:kworker.0 Request processed in 85us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.378922:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876835055570176:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789892687.378932:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789892687.378933:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2456 00000100:00100000:3.0:1789892687.378935:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 513 00000100:00080000:1.0:1789892687.378941:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789892687.378953:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892687.378975:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba326300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876835055570176:12345-0@lo:400:kworker.0 Request processed in 58us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.378984:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 514 00000100:00100000:3.0:1789892687.379006:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892687.379009:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892687.379030:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569792 00000100:00100000:2.0:1789892687.379035:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569792 00010000:00080000:1.0:1789892687.379046:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9030a1e75f80 x1876835055570176/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892687.379051:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055570304:0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.379070:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876835055570176:0@lo:400:kworker.0 00000100:00100000:0.0:1789892687.379073:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bda680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055569152:0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.379074:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 515 00000100:00100000:2.0:1789892687.379094:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876835055569792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.379096:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892687.379100:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055569536:0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.379120:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055570048:0@lo:400:kworker.0 00000100:00100000:0.0:1789892687.379129:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892687.379142:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055569024:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.379157:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90308457dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055568640:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1789892687.379158:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+11:3620:x1876835055569792:12345-0@lo:400:kworker.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.379177:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 515 00000100:00100000:3.0:1789892687.379184:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055568512:0@lo:400:kworker.0 00000100:00100000:0.0:1789892687.379190:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055568768:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892687.379197:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055570304 00000100:00100000:1.0:1789892687.379201:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055570432 00000100:00100000:2.0:1789892687.379204:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055570304 00000100:00100000:1.0:1789892687.379208:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055570432 00000100:00100000:0.0:1789892687.379214:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055569408:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.379221:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3620:1876835055569280:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.379246:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e77800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3620:1876835055569792:0@lo:400:kworker.0 00000100:00100000:0.0:1789892687.379246:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055569920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892687.379248:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1789892687.379260:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 517 00000100:00100000:2.0:1789892687.379266:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055570304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892687.379275:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055570432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.379311:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055569664 00000100:00080000:0.0:1789892687.379317:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789892687.379318:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055569664 00000100:00100000:2.0:1789892687.379327:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055570304:12345-0@lo:400:kworker.0 Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892687.379339:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 516 00000100:00100000:1.0:1789892687.379340:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba325c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055570432:12345-0@lo:400:kworker.0 Request processed in 66us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892687.379350:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 517 00000100:00100000:3.0:1789892687.379362:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00010000:00080000:0.0:1789892687.379363:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9030a1e74700 x1876835055570432/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892703 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789892687.379376:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055569664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892687.379382:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055570432:0@lo:400:kworker.0 00000100:00100000:2.0:1789892687.379395:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055570304:0@lo:400:kworker.0 00000100:00100000:3.0:1789892687.379430:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba327100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055569664:12345-0@lo:400:kworker.0 Request processed in 56us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892687.379440:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1789892687.379457:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055569664:0@lo:400:kworker.0 00010000:00010000:3.0:1789892687.953913:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789892688.325066:0:218000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-quota test 72: lfs quota --pool prints only pool's OSTs ========================================================== 04:24:47 (1789892687) 00000100:00100000:2.0:1789892688.913837:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055570560:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892688.913941:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892688.913989:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055570560 00000100:00100000:0.0:1789892688.913999:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055570560 00000100:00100000:0.0:1789892688.914068:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1789892688.914082:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055570560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789892688.914121:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892688.914195:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055570560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892688.914206:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789892688.914232:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055570560:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789892688.977805:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789892689.458970:0:218176:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892689.458977:0:218176:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000020:00000004:0.0:1789892689.476142:0:218183:0:(tgt_mount.c:2344:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789892689.476152:0:218183:0:(tgt_mount.c:2359:is_cmd_supported()) ioctl cmd=c0185879 00000100:00100000:1.0:1789892689.492212:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892689.492262:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062751488 00000100:00100000:2.0:1789892689.492275:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062751488 00000100:00080000:1.0:1789892689.492312:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892689.492353:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2812 00000100:00100000:2.0:1789892689.492367:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216914:x1876835062751488:12345-192.168.203.53@tcp:101:lfs.0 00010000:00010000:2.0:1789892689.492392:0:190671:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892689.492421:0:190671:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382c00/0xd5b980e0d62af946 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260447 expref: -99 pid: 190671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492508:0:190671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492523:0:190671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492547:0:190671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492560:0:190671:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492565:0:190671:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492570:0:190671:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492618:0:190671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492624:0:190671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492631:0:190671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492636:0:190671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383c00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892689.492641:0:190671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492646:0:190671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492657:0:190671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:2.0:1789892689.492661:0:190671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892689.492665:0:190671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492722:0:190671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383c00/0xd5b980e0d62af94d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492745:0:190671:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492753:0:190671:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492761:0:190671:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492769:0:190671:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383e00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:2.0:1789892689.492774:0:190671:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492782:0:190671:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492793:0:190671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff9030840d3b00) 00010000:00010000:2.0:1789892689.492796:0:190671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892689.492800:0:190671:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492804:0:190671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d383e00/0xd5b980e0d62af954 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 190671 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492838:0:190671:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382c00/0xd5b980e0d62af946 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260447 expref: 7 pid: 190671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492876:0:190671:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:2.0:1789892689.492878:0:190671:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789892689.492881:0:190671:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90319d382c00/0xd5b980e0d62af946 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260447 expref: 7 pid: 190671 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892689.492892:0:190671:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382c00, rc 0) 00000100:00100000:2.0:1789892689.492968:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216914:x1876835062751488:12345-192.168.203.53@tcp:101:lfs.0 Request processed in 604us (762us total) trans 0 rc 301/301 00000100:00100000:2.0:1789892689.492978:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2812 00000100:00100000:3.0:1789892689.495196:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892689.495252:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062751744 00000100:00100000:1.0:1789892689.495259:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062751744 00000100:00100000:1.0:1789892689.495314:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2813 00000100:00100000:1.0:1789892689.495328:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+6:216914:x1876835062751744:12345-192.168.203.53@tcp:36:lfs.0 00010000:00010000:1.0:1789892689.495379:0:192197:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892689.495400:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6c00/0xd5b980e0d62af92a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260439 expref: 6 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.495434:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184ec00) 00010000:00010000:1.0:1789892689.495446:0:192197:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892689.495489:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.495501:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.495512:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.495524:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.495531:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.495538:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496313:0:192197:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496325:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496335:0:192197:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789892689.496353:0:192197:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000cfaeaf26 reply state 00000000a225df7d transno 12884904341 ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496381:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496389:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff90309184e000) 00010000:00010000:1.0:1789892689.496392:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789892689.496395:0:192197:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789892689.496401:0:192197:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00010000:00010000:1.0:1789892689.496409:0:192197:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496417:0:192197:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496424:0:192197:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496430:0:192197:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7200 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:1.0:1789892689.496436:0:192197:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496443:0:192197:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496454:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90309184e800) 00010000:00010000:1.0:1789892689.496457:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789892689.496461:0:192197:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496468:0:192197:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7200/0xd5b980e0d62af95b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789892689.496497:0:192197:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 00000000cfaeaf26 reply state 00000000a225df7d transno 12884904341 ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496506:0:192197:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892689.496515:0:192197:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff90309184ee00) 00010000:00010000:1.0:1789892689.496519:0:192197:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789892689.496521:0:192197:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789892689.496595:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:3400b0a6-c22f-4041-a424-3221ecd8e600+7:216914:x1876835062751744:12345-192.168.203.53@tcp:36:lfs.0 Request processed in 1270us (1400us total) trans 12884904341 rc 0/0 00000100:00100000:1.0:1789892689.496605:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2813 00000100:00100000:2.0:1789892689.501253:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892689.501305:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062751872 00000100:00100000:0.0:1789892689.501317:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062751872 00000100:00100000:0.0:1789892689.501372:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2814 00000100:00100000:0.0:1789892689.501381:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+7:216915:x1876835062751872:12345-192.168.203.53@tcp:101:chmod.0 00010000:00010000:0.0:1789892689.501404:0:190669:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892689.501422:0:190669:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af970 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26044e expref: -99 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.501477:0:190669:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99800/0xd5b980e0d62af977 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.501488:0:190669:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99800/0xd5b980e0d62af977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.501499:0:190669:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99800/0xd5b980e0d62af977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892689.501546:0:190669:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1789892689.501549:0:190669:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892689.501566:0:190669:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99800/0xd5b980e0d62af977 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190669 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.501586:0:190669:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98600/0xd5b980e0d62af970 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26044e expref: 9 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.501599:0:190669:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99800/0xd5b980e0d62af977 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26044e expref: 8 pid: 190669 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.501606:0:190669:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903193e6f500) 00010000:00010000:0.0:1789892689.501609:0:190669:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892689.501612:0:190669:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99800, rc 0) 00000100:00100000:0.0:1789892689.501667:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90308457dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+8:216915:x1876835062751872:12345-192.168.203.53@tcp:101:chmod.0 Request processed in 288us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892689.501673:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2814 00000100:00100000:2.0:1789892689.502549:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892689.502628:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752000 00000100:00100000:0.0:1789892689.502635:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752000 00000100:00100000:0.0:1789892689.502853:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2815 00000100:00100000:0.0:1789892689.502880:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+8:216915:x1876835062752000:12345-192.168.203.53@tcp:101:chmod.0 00010000:00010000:0.0:1789892689.502890:0:190670:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892689.502900:0:190670:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af97e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260455 expref: -99 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.502938:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.502958:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.502964:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.502973:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.502980:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.502985:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503046:0:190670:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98000/0xd5b980e0d62af993 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503051:0:190670:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98000/0xd5b980e0d62af993 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503056:0:190670:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98000/0xd5b980e0d62af993 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789892689.503080:0:190670:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00000004:00200000:0.0:1789892689.503084:0:190670:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1789892689.503096:0:190670:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98000/0xd5b980e0d62af993 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503108:0:190670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503127:0:190670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503135:0:190670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503142:0:190670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99c00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892689.503148:0:190670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503155:0:190670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503171:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff903193e6f500) 00010000:00010000:0.0:1789892689.503174:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892689.503178:0:190670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503182:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e99c00/0xd5b980e0d62af985 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503199:0:190670:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503203:0:190670:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503208:0:190670:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503215:0:190670:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98e00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892689.503224:0:190670:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503229:0:190670:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503239:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff90309184ee00) 00010000:00010000:0.0:1789892689.503240:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892689.503242:0:190670:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503247:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98e00/0xd5b980e0d62af98c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 190670 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503288:0:190670:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98c00/0xd5b980e0d62af97e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260455 expref: 10 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503312:0:190670:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98000/0xd5b980e0d62af993 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260455 expref: 9 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892689.503318:0:190670:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff90309184e000) 00010000:00010000:0.0:1789892689.503322:0:190670:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789892689.503326:0:190670:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98000, rc 0) 00000100:00100000:0.0:1789892689.503374:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+9:216915:x1876835062752000:12345-192.168.203.53@tcp:101:chmod.0 Request processed in 513us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892689.503381:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2815 00000100:00100000:2.0:1789892689.504489:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892689.504517:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752256 00000100:00100000:3.0:1789892689.504524:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752256 00000100:00100000:3.0:1789892689.504576:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2816 00000100:00100000:3.0:1789892689.504595:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+9:216915:x1876835062752256:12345-192.168.203.53@tcp:36:chmod.0 00010000:00010000:3.0:1789892689.504641:0:192563:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892689.504660:0:192563:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e98000/0xd5b980e0d62af993 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x83:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260455 expref: 9 pid: 190670 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892689.504675:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff90309184e000) 00010000:00010000:3.0:1789892689.504721:0:192563:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892689.504743:0:192563:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892689.504762:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892689.504769:0:192563:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789892689.504924:0:192563:0:(mdt_handler.c:4518:mdt_save_lock()) ### save lock request 000000003b699e35 reply state 00000000cd0c3215 transno 12884904342 ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892689.504937:0:192563:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892689.504943:0:192563:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff90309184e000) 00010000:00010000:3.0:1789892689.504946:0:192563:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1789892689.504948:0:192563:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789892689.504953:0:192563:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x83:0x0]: returning size 4096 00000100:00100000:3.0:1789892689.505010:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+10:216915:x1876835062752256:12345-192.168.203.53@tcp:36:chmod.0 Request processed in 425us (523us total) trans 12884904342 rc 0/0 00000100:00100000:3.0:1789892689.505016:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2816 00000100:00100000:2.0:1789892689.595762:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892689.595843:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752384 00000100:00100000:0.0:1789892689.595857:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752384 00000100:00100000:2.0:1789892689.595875:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892689.595943:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752512 00000100:00100000:1.0:1789892689.595955:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752512 00000100:00100000:0.0:1789892689.595970:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2457 00000100:00100000:0.0:1789892689.595986:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062752384:12345-192.168.203.53@tcp:400:kworker.0 00000100:00080000:2.0:1789892689.595999:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892689.596048:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 518 00000100:00100000:1.0:1789892689.596059:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062752512:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:0.0:1789892689.596084:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062752384:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 101us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892689.596094:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2457 00000100:00100000:1.0:1789892689.596129:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062752512:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 68us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892689.596137:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 518 00010000:00010000:2.0:1789892690.002638:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789892690.288226:0:218289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffebe568fa0 20000000:00000080:1.0:1789892690.288239:0:218289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff903089e59800 uarg=0000000000000000 20000000:01000000:1.0:1789892690.288274:0:218289:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:1.0:1789892690.288276:0:218289:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:1.0:1789892690.288278:0:218289:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='quota.ost=ugp' 20000000:01000000:1.0:1789892690.288282:0:218289:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'quota.ost=ugp' 20000000:01000000:1.0:1789892690.288286:0:218289:0:(mgs_llog.c:4246:mgs_write_log_quota()) global 'quota.ost=ugp' 20000000:01000000:1.0:1789892690.288330:0:218289:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1789892690.288333:0:218289:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/quota.ost fl=4 20000000:01000000:1.0:1789892690.288631:0:218290:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 182 marker 167 1->4: lustre quota.ost 20000000:01000000:1.0:1789892690.288673:0:218290:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 184 marker 167 2->4: lustre quota.ost 00000040:00080000:1.0:1789892690.288725:0:218290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 215 count 211 00000040:00080000:3.0:1789892690.288845:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].215, 224 off47688 00000040:00080000:3.0:1789892690.288891:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].216, 88 off47776 00000040:00080000:3.0:1789892690.288912:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].217, 224 off48000 20000000:01000000:3.0:1789892690.288926:0:218289:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789892690.288928:0:218289:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/quota.ost fl=4 20000000:01000000:3.0:1789892690.289163:0:218291:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 182 marker 168 1->4: lustre quota.ost 20000000:01000000:3.0:1789892690.289181:0:218291:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 184 marker 168 2->4: lustre quota.ost 00000040:00080000:3.0:1789892690.289192:0:218291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 215 count 211 00000040:00080000:1.0:1789892690.289286:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].215, 224 off47688 00000040:00080000:1.0:1789892690.289302:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].216, 88 off47776 00000040:00080000:1.0:1789892690.289312:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].217, 224 off48000 20000000:01000000:1.0:1789892690.289318:0:218289:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789892690.289319:0:218289:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/quota.ost fl=4 20000000:01000000:3.0:1789892690.289485:0:218292:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 35 marker 169 1->4: lustre quota.ost 20000000:01000000:3.0:1789892690.289503:0:218292:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 37 marker 169 2->4: lustre quota.ost 00000040:00080000:3.0:1789892690.289512:0:218292:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 38 count 38 00000040:00080000:1.0:1789892690.289594:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14992 00000040:00080000:1.0:1789892690.289609:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 88 off15080 00000040:00080000:1.0:1789892690.289618:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 224 off15304 20000000:01000000:1.0:1789892690.289624:0:218289:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789892690.289625:0:218289:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/quota.ost fl=4 20000000:01000000:2.0:1789892690.290054:0:218293:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 170 1->4: lustre quota.ost 20000000:01000000:2.0:1789892690.290079:0:218293:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 40 marker 170 2->4: lustre quota.ost 00000040:00080000:2.0:1789892690.290087:0:218293:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 41 count 41 00000040:00080000:1.0:1789892690.290169:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 224 off15520 00000040:00080000:1.0:1789892690.290184:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 88 off15608 00000040:00080000:1.0:1789892690.290193:0:218289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15832 10000000:01000000:1.0:1789892690.290200:0:218289:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892690.290217:0:218289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290231:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290237:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290242:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290246:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290250:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290261:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290265:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290270:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290274:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290280:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290285:0:218289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290289:0:218289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290320:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290330:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.290341:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055570688:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892690.290424:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 9 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290439:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 9 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.290449:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055570816:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892690.290484:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290492:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 23 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.290522:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055570944:0@lo:104: 00000100:00100000:1.0:1789892690.290559:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892690.290590:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.290598:0:190654:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055570944 00010000:00010000:1.0:1789892690.290599:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 23 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.290605:0:190654:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055570944 00000100:00100000:1.0:1789892690.290608:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571072:0@lo:104: 00000100:00100000:1.0:1789892690.290637:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892690.290656:0:190654:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789892690.290657:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571072 00000100:00100000:3.0:1789892690.290663:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571072 00010000:00010000:1.0:1789892690.290669:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.290674:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00010000:00010000:1.0:1789892690.290704:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 23 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.290710:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055570944:12345-0@lo:104: 00000100:00100000:1.0:1789892690.290714:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571200:0@lo:104: 00010000:00010000:0.0:1789892690.290723:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.290739:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892690.290767:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571200 00000100:00100000:3.0:1789892690.290771:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571200 00000100:00100000:2.0:1789892690.290784:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00010000:00010000:0.0:1789892690.290785:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789892690.290797:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218289:x1876835055570944:12345-0@lo:104: Request processed in 88us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892690.290798:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319ca55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218289:x1876835055571072:12345-0@lo:104: 00000100:00100000:3.0:1789892690.290803:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00010000:00010000:1.0:1789892690.290804:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.290815:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.290815:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1789892690.290820:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218289:x1876835055571200:12345-0@lo:104: 00010000:00010000:1.0:1789892690.290820:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 23 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.290835:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.290846:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571328:0@lo:104: 00010000:00010000:0.0:1789892690.290847:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789892690.290868:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.290878:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892690.290882:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.290891:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.290893:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789892690.290898:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789892690.290904:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.290906:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319ca55850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055571072:12345-0@lo:104: Request processed in 111us (268us total) trans 0 rc 0/0 10000000:01000000:0.0:1789892690.290930:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892690.290931:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00010000:00010000:1.0:1789892690.290931:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.290944:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 23 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.290957:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571456:0@lo:104: 00010000:00010000:0.0:1789892690.290964:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.290970:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571328 00010000:00010000:0.0:1789892690.290971:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892690.290975:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571328 00000100:00100000:1.0:1789892690.290991:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892690.290999:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892690.290999:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571456 00010000:00010000:0.0:1789892690.291003:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291005:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571456 00000100:00100000:3.0:1789892690.291010:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218289:x1876835055571200:12345-0@lo:104: Request processed in 194us (269us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892690.291019:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291023:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 525 00010000:00010000:0.0:1789892690.291025:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382800/0xd5b980e0d62af8c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8cf expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291034:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218289:x1876835055571328:12345-0@lo:104: 00000100:00100000:3.0:1789892690.291035:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00010000:00010000:1.0:1789892690.291038:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 23 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291049:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291050:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:1.0:1789892690.291054:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571712:0@lo:104: 00010000:00010000:0.0:1789892690.291057:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.291063:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 526 00010000:00010000:0.0:1789892690.291072:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382200 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892690.291077:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055571456:12345-0@lo:104: 10000000:00010000:0.0:1789892690.291079:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291088:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291092:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291100:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789892690.291104:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291107:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:01000000:0.0:1789892690.291111:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892690.291117:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055571328:12345-0@lo:104: Request processed in 83us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892690.291124:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 525 00010000:00010000:1.0:1789892690.291128:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291130:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291138:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571712 00010000:00010000:0.0:1789892690.291138:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892690.291140:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789892690.291143:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571712 00010000:00010000:1.0:1789892690.291143:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 23 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.291151:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055571456:12345-0@lo:104: Request processed in 76us (157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892690.291162:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:1.0:1789892690.291163:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571840:0@lo:104: 00010000:00010000:0.0:1789892690.291169:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.291172:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 526 00000100:00100000:2.0:1789892690.291172:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055571712:12345-0@lo:104: 00010000:00010000:2.0:1789892690.291186:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291187:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62af8ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8c1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291203:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892690.291204:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892690.291211:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892690.291212:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291218:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291226:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892690.291230:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383200 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892690.291231:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:3.0:1789892690.291233:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.291238:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892690.291238:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291245:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218289:x1876835055571712:12345-0@lo:104: Request processed in 73us (144us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892690.291263:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291264:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00010000:00010000:1.0:1789892690.291266:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 23 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892690.291283:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291284:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291284:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571840 00000100:00100000:1.0:1789892690.291286:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055572096:0@lo:104: 00000100:00100000:2.0:1789892690.291290:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571840 10000000:01000000:0.0:1789892690.291301:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789892690.291304:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892690.291310:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892690.291314:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00010000:00010000:0.0:1789892690.291323:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291324:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892690.291330:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892690.291333:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291334:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218289:x1876835055571840:12345-0@lo:104: 00010000:00010000:0.0:1789892690.291341:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291347:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.291350:0:218289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291351:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892690.291363:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291365:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af89e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8a5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.291375:0:218289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 23 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291383:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383800/0xd5b980e0d62af8ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af8b3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291393:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892690.291394:0:218289:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055572480:0@lo:104: 00000100:00100000:2.0:1789892690.291403:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837eb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218289:x1876835055571840:12345-0@lo:104: Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892690.291408:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00010000:00010000:0.0:1789892690.291411:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789892690.291416:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291420:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572096 00000100:00100000:2.0:1789892690.291424:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572096 00010000:00010000:0.0:1789892690.291426:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:1.0:1789892690.291430:0:218289:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1789892690.291431:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291439:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291442:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789892690.291446:0:218289:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084bc06c0 going to sleep for 11 seconds 10000000:00010000:0.0:1789892690.291448:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291453:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572480 10000000:01000000:0.0:1789892690.291454:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892690.291456:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572480 00010000:00010000:3.0:1789892690.291466:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892690.291471:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291473:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055570944:0@lo:104: 00000100:00100000:2.0:1789892690.291474:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00010000:00010000:0.0:1789892690.291477:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291487:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055572096:12345-0@lo:104: 00010000:00010000:3.0:1789892690.291492:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:1.0:1789892690.291494:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571072:0@lo:104: 10000000:00010000:3.0:1789892690.291498:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291499:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892690.291500:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291506:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571200:0@lo:104: 00010000:00010000:0.0:1789892690.291509:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291521:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291522:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571328:0@lo:104: 00010000:00010000:0.0:1789892690.291530:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383400/0xd5b980e0d62af890 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af897 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892690.291537:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291543:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571456:0@lo:104: 00010000:00010000:2.0:1789892690.291546:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1789892690.291547:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789892690.291555:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892690.291556:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1789892690.291556:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218289:x1876835055572096:12345-0@lo:104: Request processed in 72us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892690.291563:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571712:0@lo:104: 00000100:00100000:2.0:1789892690.291573:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00010000:00010000:3.0:1789892690.291577:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.291583:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e75f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055571840:0@lo:104: 00000100:00100000:2.0:1789892690.291588:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00010000:00010000:3.0:1789892690.291598:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892690.291600:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383000 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:2.0:1789892690.291602:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031ba37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218289:x1876835055572480:12345-0@lo:104: 00000100:00100000:1.0:1789892690.291606:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055572096:0@lo:104: 00010000:00010000:3.0:1789892690.291607:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892690.291607:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291610:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291631:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62af882 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af889 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291631:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291651:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 10000000:00010000:0.0:1789892690.291654:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291655:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789892690.291663:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.291668:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031ba37fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218289:x1876835055572480:12345-0@lo:104: Request processed in 67us (236us total) trans 0 rc 0/0 10000000:01000000:0.0:1789892690.291670:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1789892690.291672:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055572480:0@lo:104: 00000100:00100000:2.0:1789892690.291704:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00010000:00010000:0.0:1789892690.291719:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291727:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892690.291734:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291742:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62af874 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af87b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291749:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892690.291754:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291755:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789892690.291759:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892690.291763:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382e00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892690.291763:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892690.291770:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ca00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892690.291770:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.291775:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789892690.291777:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291783:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291787:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.291792:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055571584:0@lo:103:ldlm_bl.0 10000000:00010000:2.0:1789892690.291793:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892690.291800:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892690.291811:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789892690.291813:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1789892690.291836:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892690.291837:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291840:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291869:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892690.291878:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892690.291879:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.291887:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055572608:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892690.291891:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382e00/0xd5b980e0d62af858 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af85f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.291900:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291908:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892690.291913:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892690.291914:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9ca00/0xd5b980e0d62af866 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af86d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.291918:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892690.291930:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892690.291934:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892690.291934:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892690.291935:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892690.291941:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892690.291966:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571584 00000100:00100000:0.0:1789892690.291970:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055573120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892690.291972:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571584 00000100:00100000:3.0:1789892690.291988:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055572352:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892690.291996:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 24 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292006:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892690.292025:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572608 00000100:00100000:1.0:1789892690.292028:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572608 00010000:00010000:1.0:1789892690.292040:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 25 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.292058:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573120 00000100:00100000:1.0:1789892690.292061:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573120 00000100:00100000:3.0:1789892690.292067:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892690.292078:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 26 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292092:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055571968:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892690.292096:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572352 00000100:00100000:3.0:1789892690.292097:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055572992:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892690.292102:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572352 00000100:00100000:2.0:1789892690.292106:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1789892690.292120:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 27 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292136:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892690.292140:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752640 00000100:00100000:1.0:1789892690.292143:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752640 00000100:00100000:2.0:1789892690.292155:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055571968 00010000:00010000:1.0:1789892690.292158:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 10 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292162:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055571968 00000100:00100000:3.0:1789892690.292167:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1789892690.292177:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055572736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892690.292183:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3619:x1876835055571584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892690.292187:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 28 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.292190:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 577 00010000:00010000:3.0:1789892690.292197:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892690.292205:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3619:x1876835055572608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.292206:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 28 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292207:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892690.292216:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572736 00010000:00010000:1.0:1789892690.292220:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892690.292221:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572736 00010000:00010000:3.0:1789892690.292223:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 28 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292228:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00010000:00010000:1.0:1789892690.292231:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 29 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292237:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055572224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.292240:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99000/0xd5b980e0d62af8cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af8c8 expref: 29 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.292242:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 29 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.292263:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892690.292269:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892690.292272:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 28 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292281:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572224 00000100:00100000:2.0:1789892690.292285:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572224 00010000:00010000:1.0:1789892690.292287:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6e00/0xd5b980e0d62af897 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af890 expref: 28 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292290:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055572864:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892690.292300:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 28 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292302:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892690.292304:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3619:x1876835055571584:12345-0@lo:103:ldlm_bl.0 Request processed in 125us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892690.292321:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 576 00000100:00100000:0.0:1789892690.292326:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892690.292333:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 578 00000100:00100000:1.0:1789892690.292333:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3619:x1876835055572608:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892690.292345:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572864 00000100:00100000:2.0:1789892690.292348:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3619:x1876835055573120:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892690.292349:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 577 00000100:00100000:3.0:1789892690.292357:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572864 00010000:00010000:2.0:1789892690.292358:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892690.292363:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 28 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292370:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 579 00010000:00010000:3.0:1789892690.292377:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 27 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.292378:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 27 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292384:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055572352:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892690.292385:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 580 00000100:00100000:1.0:1789892690.292397:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062752640:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892690.292402:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892690.292408:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62af86d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af866 expref: 27 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292409:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892690.292410:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 27 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.292418:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 581 00010000:00010000:1.0:1789892690.292419:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 10 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.292432:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3620:x1876835055571968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892690.292434:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 26 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.292441:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892690.292447:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 26 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292450:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 10 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892690.292460:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892690.292469:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 26 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.292469:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99600/0xd5b980e0d62af8b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af8ac expref: 26 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292486:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+26:3619:x1876835055573120:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (478us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892690.292496:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892690.292496:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892690.292497:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98800/0xd5b980e0d62af8c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af8ba expref: 25 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292502:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 578 00010000:00010000:3.0:1789892690.292515:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892690.292535:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062752640:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 137us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892690.292544:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3618:x1876835055572352:12345-0@lo:103:ldlm_bl.0 Request processed in 165us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892690.292545:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 580 00000100:00100000:2.0:1789892690.292552:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 582 00000100:00100000:3.0:1789892690.292559:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055571968:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892690.292567:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3620:x1876835055572736:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892690.292569:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 579 00010000:00010000:2.0:1789892690.292577:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892690.292582:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 581 00010000:00010000:2.0:1789892690.292584:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 22 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.292591:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 583 00010000:00010000:2.0:1789892690.292597:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 21 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292599:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 584 00000100:00100000:1.0:1789892690.292605:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3620:x1876835055572224:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892690.292610:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3620:x1876835055572864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892690.292615:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7e00/0xd5b980e0d62af889 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af882 expref: 21 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292616:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892690.292619:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892690.292623:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892690.292629:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 20 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.292629:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 20 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292642:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 20 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292648:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055572736:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892690.292657:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 582 00010000:00010000:0.0:1789892690.292657:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 20 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292702:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6200/0xd5b980e0d62af8a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af89e expref: 19 pid: 194990 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.292712:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af87b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af874 expref: 18 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892690.292713:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892690.292719:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892690.292729:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892690.292752:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055572992 00000100:00100000:1.0:1789892690.292756:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3620:x1876835055572224:12345-0@lo:103:ldlm_bl.0 Request processed in 154us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892690.292757:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055572992 00000100:00100000:0.0:1789892690.292765:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1cf8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:3620:x1876835055572864:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892690.292768:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 583 00010000:00010000:3.0:1789892690.292775:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 18 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292775:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 584 00000100:00100000:2.0:1789892690.292776:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055572352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892690.292800:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 585 00000100:00100000:2.0:1789892690.292816:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892690.292817:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055570688:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892690.292817:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055572992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892690.292827:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892690.292831:0:191420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752768 00010000:00010000:0.0:1789892690.292834:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 16 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.292835:0:191420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752768 00010000:00010000:1.0:1789892690.292836:0:218289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7a00/0xd5b980e0d62af8d6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26041d expref: 9 pid: 190662 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892690.292848:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 16 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.292867:0:191420:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892690.292871:0:218289:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218289:1876835055570816:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892690.292878:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055573120:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892690.292883:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98200/0xd5b980e0d62af85f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af858 expref: 16 pid: 190664 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292905:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055571584:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892690.292908:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892690.292918:0:191420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 586 00000100:00100000:2.0:1789892690.292923:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055572608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892690.292932:0:218289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.292939:0:191420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062752768:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.292951:0:191420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892690.292952:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3618:x1876835055572992:12345-0@lo:103:ldlm_bl.0 Request processed in 142us (234us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892690.292959:0:191420:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.292969:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 585 00010000:00010000:3.0:1789892690.292976:0:191420:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.292987:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055572224:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.292988:0:191420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62af8dd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260424 expref: 9 pid: 190663 timeout: 3480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.293003:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055572864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.293004:0:191420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.293011:0:191420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892690.293014:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e75880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055572992:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.293027:0:191420:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.293027:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055571968:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.293040:0:191420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892690.293043:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055572736:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892690.293052:0:191420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.293057:0:191420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.293061:0:191420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:3.0:1789892690.293064:0:191420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.293075:0:191420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.293089:0:191420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892690.293096:0:191420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892690.293112:0:218289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.293121:0:191420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2396:x1876835062752768:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 186us (310us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892690.293125:0:218289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892690.293130:0:191420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 586 00010000:00010000:1.0:1789892690.293139:0:218289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7400/0xd5b980e0d62af9a1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.025829:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789892691.921724:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789892691.921729:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 190 10000000:01000000:3.0:1789892691.921734:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789892691.921774:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.921787:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.921800:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892691.921827:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.921900:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.921955:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.921955:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573248 00000100:00100000:2.0:1789892691.921965:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573248 00000100:00100000:2.0:1789892691.922017:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2458 00000100:00100000:2.0:1789892691.922027:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055573248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892691.922039:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892691.922051:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9a8 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.922072:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 16 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.922080:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 16 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.922088:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892691.922131:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055573248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.922137:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2458 00000100:00100000:3.0:1789892691.922158:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892691.922177:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.922198:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892691.922284:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.922321:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.922344:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.922364:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573376 00000100:00100000:3.0:1789892691.922369:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573376 00000100:00100000:3.0:1789892691.922406:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2459 00000100:00100000:3.0:1789892691.922417:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055573376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.922551:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055573376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.922561:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2459 00000100:00100000:0.0:1789892691.922575:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.922612:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.922660:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.922729:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573504 00000100:00100000:0.0:1789892691.922729:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823df540 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.922737:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573504 00000100:00100000:3.0:1789892691.922784:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2460 00000100:00100000:3.0:1789892691.922795:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055573504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.922915:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055573504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.922922:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2460 00000100:00100000:0.0:1789892691.922943:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789892691.923528:0:218529:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789892691.923595:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789892691.923618:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892691.923624:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.923632:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892691.923644:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1789892691.923646:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 38 10000000:01000000:3.0:1789892691.923647:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789892691.923663:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.923669:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.923674:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892691.923707:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.923735:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.923756:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573632 00000100:00100000:3.0:1789892691.923761:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a5463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.923762:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573632 00000100:00100000:0.0:1789892691.923793:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2461 00000100:00100000:0.0:1789892691.923801:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055573632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892691.923808:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892691.923816:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9b6 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.923830:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.923837:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 17 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.923874:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98a00, rc 0) 00000100:00100000:0.0:1789892691.923919:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055573632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.923926:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2461 00000100:00100000:3.0:1789892691.923935:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892691.923946:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.923952:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892691.923986:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.924008:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.924023:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a5463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.924030:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573760 00000100:00100000:0.0:1789892691.924035:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573760 00000100:00100000:0.0:1789892691.924057:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2462 00000100:00100000:0.0:1789892691.924063:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055573760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.924130:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055573760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.924137:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2462 00000100:00100000:3.0:1789892691.924149:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.924177:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.924207:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.924223:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a5463c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.924228:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055573888 00000100:00100000:0.0:1789892691.924233:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055573888 00000100:00100000:0.0:1789892691.924262:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2463 00000100:00100000:0.0:1789892691.924268:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055573888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.924338:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055573888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 71us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.924344:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2463 00000100:00100000:3.0:1789892691.924368:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055573888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.924514:0:218530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218530:1876835055574016:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892691.924543:0:218530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.924567:0:218530:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.924579:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574016 00000100:00100000:0.0:1789892691.924583:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574016 00000100:00100000:0.0:1789892691.924605:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2464 00000100:00100000:0.0:1789892691.924611:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:218530:x1876835055574016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892691.924782:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:218530:x1876835055574016:12345-0@lo:502:llog_process_th.0 Request processed in 170us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.924789:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2464 00000100:00100000:3.0:1789892691.924900:0:218530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218530:1876835055574016:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892691.924919:0:218530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892691.924926:0:218530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892691.924928:0:218530:0:(obd_config.c:1561:class_process_config()) marker 203 (0x1) lustre quota.ost 00000020:00000080:3.0:1789892691.924934:0:218530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789892691.924952:0:218530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218530:1876835055574144:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892691.924984:0:218530:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.925023:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574144 00000100:00100000:0.0:1789892691.925028:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574144 00000100:00100000:3.0:1789892691.925030:0:218530:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.925061:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2465 00000100:00100000:0.0:1789892691.925068:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:218530:x1876835055574144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892691.925136:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:218530:x1876835055574144:12345-0@lo:502:llog_process_th.0 Request processed in 68us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.925143:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2465 00000100:00100000:3.0:1789892691.925150:0:218530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218530:1876835055574144:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892691.925177:0:218530:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892691.925181:0:218530:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892691.925183:0:218530:0:(obd_config.c:1561:class_process_config()) marker 203 (0x2) lustre quota.ost 00000040:00080000:3.0:1789892691.925186:0:218530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 41 count 41 00000020:01000000:2.0:1789892691.925257:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 38-40 (rc=0) 10000000:01000000:2.0:1789892691.925283:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789892691.925289:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.925297:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892691.925311:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789892691.925313:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 190 10000000:01000000:2.0:1789892691.925316:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789892691.925330:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.925335:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.925340:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.925351:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892691.925376:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892691.925393:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030834de480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.925399:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574272 00000100:00100000:3.0:1789892691.925403:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574272 00000100:00100000:3.0:1789892691.925428:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2466 00000100:00100000:3.0:1789892691.925434:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055574272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892691.925440:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892691.925453:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9c4 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.925464:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 18 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.925470:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 18 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.925475:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9dc00, rc 0) 00000100:00100000:3.0:1789892691.925506:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055574272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.925512:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2466 00000100:00100000:2.0:1789892691.925535:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892691.925549:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.925555:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.925598:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892691.925624:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892691.925640:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030834de480 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.925642:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574400 00000100:00100000:3.0:1789892691.925647:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574400 00000100:00100000:3.0:1789892691.925672:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2467 00000100:00100000:3.0:1789892691.925700:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055574400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.925773:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055574400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 95us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.925780:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2467 00000100:00100000:1.0:1789892691.925797:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e77800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.925840:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.925898:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.925925:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574528 00000100:00100000:0.0:1789892691.925929:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574528 00000100:00100000:1.0:1789892691.925932:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084bc0600 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.925958:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2468 00000100:00100000:0.0:1789892691.925965:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055574528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.926029:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055574528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.926034:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2468 00000100:00100000:1.0:1789892691.926065:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574528:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892691.926928:0:218531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:3.0:1789892691.927008:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:3.0:1789892691.927032:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789892691.927037:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.927044:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892691.927049:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1789892691.927056:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 41 10000000:01000000:3.0:1789892691.927058:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789892691.927069:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.927075:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.927080:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892691.927090:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574656:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.927117:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.927140:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.927149:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574656 00000100:00100000:0.0:1789892691.927154:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574656 00000100:00100000:0.0:1789892691.927181:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2469 00000100:00100000:0.0:1789892691.927189:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055574656:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892691.927195:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892691.927203:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9d2 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.927216:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.927222:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 19 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.927237:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98c00, rc 0) 00000100:00100000:0.0:1789892691.927270:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055574656:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.927277:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2469 00000100:00100000:3.0:1789892691.927293:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574656:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892691.927304:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.927310:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892691.927342:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.927362:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.927376:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.927387:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574784 00000100:00100000:2.0:1789892691.927393:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574784 00000100:00100000:2.0:1789892691.927426:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2470 00000100:00100000:2.0:1789892691.927432:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055574784:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892691.927503:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055574784:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.927510:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2470 00000100:00100000:3.0:1789892691.927517:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574784:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.927540:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.927573:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.927596:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.927597:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055574912 00000100:00100000:0.0:1789892691.927602:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055574912 00000100:00100000:0.0:1789892691.927626:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2471 00000100:00100000:0.0:1789892691.927632:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055574912:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.927733:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055574912:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.927738:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2471 00000100:00100000:3.0:1789892691.927748:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055574912:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.927959:0:218533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218533:1876835055575040:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892691.927991:0:218533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.928016:0:218533:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.928025:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575040 00000100:00100000:2.0:1789892691.928030:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575040 00000100:00100000:2.0:1789892691.928056:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2472 00000100:00100000:2.0:1789892691.928063:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:218533:x1876835055575040:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.928140:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:218533:x1876835055575040:12345-0@lo:502:llog_process_th.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.928147:0:218533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218533:1876835055575040:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.928148:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2472 00000020:01000000:3.0:1789892691.928177:0:218533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892691.928183:0:218533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892691.928185:0:218533:0:(obd_config.c:1561:class_process_config()) marker 204 (0x1) lustre quota.ost 00000020:00000080:3.0:1789892691.928189:0:218533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789892691.928203:0:218533:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218533:1876835055575168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892691.928235:0:218533:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.928250:0:218533:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308a546780 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.928263:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575168 00000100:00100000:2.0:1789892691.928267:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575168 00000100:00100000:2.0:1789892691.928291:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2473 00000100:00100000:2.0:1789892691.928297:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:218533:x1876835055575168:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.928367:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:218533:x1876835055575168:12345-0@lo:502:llog_process_th.0 Request processed in 69us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.928374:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2473 00000100:00100000:3.0:1789892691.928376:0:218533:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218533:1876835055575168:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892691.928400:0:218533:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892691.928404:0:218533:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892691.928405:0:218533:0:(obd_config.c:1561:class_process_config()) marker 204 (0x2) lustre quota.ost 00000040:00080000:3.0:1789892691.928408:0:218533:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 44 count 44 00000020:01000000:1.0:1789892691.928464:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 41-43 (rc=0) 10000000:01000000:1.0:1789892691.928483:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892691.928488:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.928496:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892691.928502:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892691.928504:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 190 10000000:01000000:1.0:1789892691.928505:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892691.928522:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.928528:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.928533:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892691.928544:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.928580:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.928597:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084bc0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.928613:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575296 00000100:00100000:3.0:1789892691.928617:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575296 00000100:00100000:3.0:1789892691.928646:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2474 00000100:00100000:3.0:1789892691.928653:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055575296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892691.928659:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892691.928666:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9e0 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.929110:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 20 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.929125:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 20 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.929131:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c000, rc 0) 00000100:00100000:3.0:1789892691.929160:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055575296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 509us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.929166:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2474 00000100:00100000:1.0:1789892691.929186:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892691.929197:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.929204:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892691.929242:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.929266:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.929291:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575424 00000100:00100000:3.0:1789892691.929296:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575424 00000100:00100000:1.0:1789892691.929298:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084bc0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.929327:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2475 00000100:00100000:3.0:1789892691.929335:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055575424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.929397:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055575424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 64us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.929403:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2475 00000100:00100000:1.0:1789892691.929425:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.929448:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.929481:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.929496:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903084bc0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.929502:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575552 00000100:00100000:3.0:1789892691.929506:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575552 00000100:00100000:3.0:1789892691.929530:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2476 00000100:00100000:3.0:1789892691.929537:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055575552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.929596:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055575552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.929602:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2476 00000100:00100000:1.0:1789892691.929614:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575552:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892691.930262:0:218536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:0.0:1789892691.930311:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:0.0:1789892691.930333:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892691.930338:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.930346:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892691.930353:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1789892691.930354:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 215 10000000:01000000:0.0:1789892691.930356:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1789892691.930368:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.930374:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.930389:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892691.930400:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.930426:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.930452:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575680 00000100:00100000:0.0:1789892691.930455:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823df900 going to sleep for 11 seconds 00000100:00100000:1.0:1789892691.930456:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575680 00000100:00100000:1.0:1789892691.930487:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2477 00000100:00100000:1.0:1789892691.930494:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055575680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892691.930500:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892691.930508:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9ee expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.930529:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.930535:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 21 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.930541:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc6600, rc 0) 00000100:00100000:1.0:1789892691.930572:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055575680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.930579:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2477 00000100:00100000:0.0:1789892691.930589:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892691.930602:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.930609:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892691.930644:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.930669:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892691.930839:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575808 00000100:00100000:3.0:1789892691.930853:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575808 00000100:00100000:0.0:1789892691.930875:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823df900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.930884:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2478 00000100:00100000:3.0:1789892691.930890:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055575808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.930966:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055575808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 74us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.930973:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2478 00000100:00100000:0.0:1789892691.930982:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.931014:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.931047:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.931064:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823df900 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.931067:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055575936 00000100:00100000:3.0:1789892691.931071:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055575936 00000100:00100000:3.0:1789892691.931096:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2479 00000100:00100000:3.0:1789892691.931103:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055575936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.931172:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055575936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.931179:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2479 00000100:00100000:0.0:1789892691.931181:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055575936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.931338:0:218537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218537:1876835055576064:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892691.931374:0:218537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.931400:0:218537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823dfa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.931401:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576064 00000100:00100000:3.0:1789892691.931405:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576064 00000100:00100000:3.0:1789892691.931429:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2480 00000100:00100000:3.0:1789892691.931435:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218537:x1876835055576064:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892691.931508:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218537:x1876835055576064:12345-0@lo:502:llog_process_th.0 Request processed in 73us (133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.931514:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2480 00000100:00100000:0.0:1789892691.931517:0:218537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218537:1876835055576064:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892691.931541:0:218537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789892691.931547:0:218537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892691.931548:0:218537:0:(obd_config.c:1561:class_process_config()) marker 201 (0x1) lustre quota.ost 00000020:00000080:0.0:1789892691.931554:0:218537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789892691.931571:0:218537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218537:1876835055576192:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892691.931603:0:218537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.931619:0:218537:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823dfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789892691.931634:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576192 00000100:00100000:1.0:1789892691.931639:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576192 00000100:00100000:1.0:1789892691.931666:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2481 00000100:00100000:1.0:1789892691.931673:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218537:x1876835055576192:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892691.931762:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218537:x1876835055576192:12345-0@lo:502:llog_process_th.0 Request processed in 90us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.931770:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2481 00000100:00100000:0.0:1789892691.931777:0:218537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218537:1876835055576192:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789892691.931798:0:218537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892691.931802:0:218537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892691.931804:0:218537:0:(obd_config.c:1561:class_process_config()) marker 201 (0x2) lustre quota.ost 00000040:00080000:0.0:1789892691.931807:0:218537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 218 count 214 00000020:01000000:1.0:1789892691.931860:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 215-217 (rc=0) 10000000:01000000:1.0:1789892691.931883:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892691.931889:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.931896:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892691.931902:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892691.931904:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 190 10000000:01000000:1.0:1789892691.931911:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892691.931924:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.931930:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.931936:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892691.931946:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.931972:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.931997:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576320 00000100:00100000:1.0:1789892691.932000:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185309900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.932002:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576320 00000100:00100000:0.0:1789892691.932034:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2482 00000100:00100000:0.0:1789892691.932042:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055576320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892691.932048:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892691.932056:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62af9fc expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.932068:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.932075:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 22 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.932080:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99c00, rc 0) 00000100:00100000:0.0:1789892691.932124:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055576320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 83us (149us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.932130:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2482 00000100:00100000:1.0:1789892691.932155:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892691.932170:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.932176:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892691.932212:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.932238:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.932256:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185309900 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.932259:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576448 00000100:00100000:0.0:1789892691.932263:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576448 00000100:00100000:0.0:1789892691.932288:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2483 00000100:00100000:0.0:1789892691.932295:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055576448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.932361:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055576448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (122us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.932368:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.932368:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2483 00000100:00100000:1.0:1789892691.932398:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.932433:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.932449:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903185309900 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.932474:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576576 00000100:00100000:2.0:1789892691.932481:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576576 00000100:00100000:2.0:1789892691.932519:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2484 00000100:00100000:2.0:1789892691.932529:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055576576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892691.932614:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055576576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.932622:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2484 00000100:00100000:1.0:1789892691.932645:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576576:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789892691.933428:0:218539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 186 00000020:01000000:0.0:1789892691.933491:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-189 (rc=0) 10000000:01000000:0.0:1789892691.933520:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789892691.933526:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.933532:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892691.933539:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789892691.933540:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 215 10000000:01000000:0.0:1789892691.933541:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789892691.933553:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.933558:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.933563:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892691.933581:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.933604:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.933629:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576704 00000100:00100000:0.0:1789892691.933633:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823dfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892691.933634:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576704 00000100:00100000:1.0:1789892691.933664:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2485 00000100:00100000:1.0:1789892691.933672:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055576704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892691.933729:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789892691.933737:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa0a expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.933750:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.933757:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.933763:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903090bc7600, rc 0) 00000100:00100000:1.0:1789892691.933798:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055576704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.933805:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2485 00000100:00100000:0.0:1789892691.933811:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892691.933825:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.933831:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892691.933882:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.933909:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.933933:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576832 00000100:00100000:0.0:1789892691.933936:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823dfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892691.933938:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576832 00000100:00100000:1.0:1789892691.933965:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2486 00000100:00100000:1.0:1789892691.933970:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055576832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.934033:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055576832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 62us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.934039:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2486 00000100:00100000:0.0:1789892691.934048:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.934071:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.934098:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.934112:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823dfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789892691.934122:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055576960 00000100:00100000:1.0:1789892691.934132:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055576960 00000100:00100000:1.0:1789892691.934157:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2487 00000100:00100000:1.0:1789892691.934165:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055576960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.934236:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055576960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.934242:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2487 00000100:00100000:0.0:1789892691.934245:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055576960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892691.934431:0:218541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218541:1876835055577088:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892691.934463:0:218541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.934480:0:218541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.934498:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577088 00000100:00100000:2.0:1789892691.934504:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577088 00000100:00100000:2.0:1789892691.934538:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2488 00000100:00100000:2.0:1789892691.934548:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218541:x1876835055577088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.934658:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218541:x1876835055577088:12345-0@lo:502:llog_process_th.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.934660:0:218541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218541:1876835055577088:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.934673:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2488 00000020:01000000:1.0:1789892691.934708:0:218541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789892691.934715:0:218541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892691.934716:0:218541:0:(obd_config.c:1561:class_process_config()) marker 202 (0x1) lustre quota.ost 00000020:00000080:1.0:1789892691.934723:0:218541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789892691.934741:0:218541:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218541:1876835055577216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892691.934772:0:218541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892691.934797:0:218541:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8480 going to sleep for 11 seconds 00000100:00100000:2.0:1789892691.934801:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577216 00000100:00100000:2.0:1789892691.934807:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577216 00000100:00100000:2.0:1789892691.934855:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2489 00000100:00100000:2.0:1789892691.934865:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218541:x1876835055577216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.934948:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218541:x1876835055577216:12345-0@lo:502:llog_process_th.0 Request processed in 84us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.934954:0:218541:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218541:1876835055577216:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892691.934960:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2489 00000020:01000000:1.0:1789892691.934976:0:218541:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789892691.934981:0:218541:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789892691.934983:0:218541:0:(obd_config.c:1561:class_process_config()) marker 202 (0x2) lustre quota.ost 00000040:00080000:1.0:1789892691.934986:0:218541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 218 count 214 00000020:01000000:2.0:1789892691.935027:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 215-217 (rc=0) 10000000:01000000:2.0:1789892691.935063:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789892691.935070:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.935080:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892691.935089:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1789892691.935091:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:2.0:1789892691.935094:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789892691.935111:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.935119:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.935133:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.935148:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055577344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892691.935184:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892691.935208:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892691.935255:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577344 00000100:00100000:3.0:1789892691.935261:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577344 00000100:00100000:3.0:1789892691.935290:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2490 00000100:00100000:3.0:1789892691.935298:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055577344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892691.935306:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892691.935315:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa18 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.935329:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.935344:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 24 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892691.935349:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9ca00, rc 0) 00000100:00100000:3.0:1789892691.935384:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055577344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892691.935391:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2490 00000100:00100000:2.0:1789892691.935403:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055577344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892691.935419:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.935427:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.935476:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055577472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892691.935507:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892691.935530:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.935534:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577472 00000100:00100000:0.0:1789892691.935539:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577472 00000100:00100000:0.0:1789892691.935566:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2491 00000100:00100000:0.0:1789892691.935572:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055577472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.935626:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055577472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 53us (118us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892691.935640:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2491 00000100:00100000:2.0:1789892691.935641:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e76a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055577472:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789892691.935675:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789892691.935925:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.935933:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1789892691.939397:0:218542:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: User quota (block hardlimit:50 MB) 00000100:00100000:2.0:1789892691.957786:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892691.957835:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062752896 00000100:00100000:0.0:1789892691.957857:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062752896 00000100:00080000:2.0:1789892691.957917:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892691.957933:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2817 00000100:00100000:0.0:1789892691.957947:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+10:217189:x1876835062752896:12345-192.168.203.53@tcp:48:lfs.0 00000001:00080000:1.0:1789892691.959332:0:190650:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884904342 is committed 00010000:00010000:0.0:1789892691.959389:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959401:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959407:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959412:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7800 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892691.959416:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959421:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959436:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xe41f642e (ffff90309184ee00) 00010000:00010000:0.0:1789892691.959439:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892691.959442:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959447:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc7800/0xd5b980e0d62af962 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xe41f642e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959463:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959475:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959480:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959484:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6a00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892691.959487:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959491:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959500:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff90309184e000) 00010000:00010000:0.0:1789892691.959501:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789892691.959503:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959507:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903090bc6a00/0xd5b980e0d62af969 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 192197 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959519:0:3605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959523:0:3605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959528:0:3605:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959532:0:3605:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9ce00 already unused, calling callback (ffffffffc192c6d0) 00010000:00010000:0.0:1789892691.959540:0:3605:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959545:0:3605:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959553:0:3605:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x83:0x0].0x0 (ffff90309184e000) 00010000:00010000:0.0:1789892691.959555:0:3605:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789892691.959557:0:3605:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.959561:0:3605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff903084e9ce00/0xd5b980e0d62af99a lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x83:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 192563 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.960228:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577600:0@lo:106: 00000100:00100000:2.0:1789892691.960276:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.960323:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577600 00000100:00100000:0.0:1789892691.960330:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577600 00000100:00100000:2.0:1789892691.960340:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577728:0@lo:106: 00000100:00100000:2.0:1789892691.960368:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.960383:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577728 00000100:00100000:0.0:1789892691.960389:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577728 00000100:00100000:1.0:1789892691.960396:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789892691.960409:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:190671:x1876835055577600:12345-0@lo:106: 00000100:00100000:2.0:1789892691.960413:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577856:0@lo:106: 00010000:00010000:1.0:1789892691.960421:0:190653:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892691.960425:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00010000:00010000:1.0:1789892691.960437:0:190653:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0001 lock: ffff9030a3134200/0xd5b980e0d62aa74c lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa761 expref: -99 pid: 193003 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892691.960439:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:190671:x1876835055577728:12345-0@lo:106: 00000100:00100000:2.0:1789892691.960451:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892691.960458:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.960466:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-OST0000 lock: ffff90309213f600/0xd5b980e0d62aa5a8 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa5b6 expref: -99 pid: 192199 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.960480:0:190671:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577984:0@lo:106: 00000100:00100000:1.0:1789892691.960505:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-OST0001+8:190671:x1876835055577600:12345-0@lo:106: Request processed in 99us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.960513:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:2.0:1789892691.960527:0:190671:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892691.960533:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e74700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-OST0000+8:190671:x1876835055577728:12345-0@lo:106: Request processed in 97us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.960534:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577856 00000100:00100000:1.0:1789892691.960540:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577856 00000100:00100000:0.0:1789892691.960545:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:2.0:1789892691.960547:0:190671:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892691.960566:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055577984 00000100:00100000:1.0:1789892691.960570:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 533 00000100:00100000:0.0:1789892691.960572:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055577984 00000100:00100000:2.0:1789892691.960577:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e75880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577600:0@lo:106: 00000100:00100000:1.0:1789892691.960578:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:190671:x1876835055577856:12345-0@lo:106: 00010000:00010000:1.0:1789892691.960591:0:190653:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892691.960598:0:190653:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0001 lock: ffff90309265e000/0xd5b980e0d62aa4ba lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa4dd expref: -99 pid: 191422 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892691.960604:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577728:0@lo:106: 00000100:00100000:0.0:1789892691.960607:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 534 00000100:00100000:0.0:1789892691.960619:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031bfb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:190671:x1876835055577984:12345-0@lo:106: 00010000:00010000:0.0:1789892691.960627:0:191419:0:(ldlm_lockd.c:2525:ldlm_callback_handler()) ### glimpse ast ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.960633:0:191419:0:(ldlm_lockd.c:2116:ldlm_handle_gl_callback()) ### client glimpse AST callback handler ns: lustre-MDT0000-lwp-MDT0000 lock: ffff9030835cae00/0xd5b980e0d62aa386 lrc: 2/0,0 mode: CR/CR res: [0x200000006:0x20000:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62aa443 expref: -99 pid: 190705 timeout: 0 lvb_type: 2 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892691.960650:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:lustre-MDT0000-lwp-MDT0001+9:190671:x1876835055577856:12345-0@lo:106: Request processed in 71us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892691.960656:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 533 00000100:00100000:2.0:1789892691.960664:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577856:0@lo:106: 00000100:00100000:0.0:1789892691.960736:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031bfb0b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:lustre-MDT0000-lwp-MDT0000+7:190671:x1876835055577984:12345-0@lo:106: Request processed in 121us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.960740:0:190671:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:190671:1876835055577984:0@lo:106: 00000100:00100000:0.0:1789892691.960746:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 534 00000100:00100000:2.0:1789892691.960864:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217189:x1876835062752896:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2901us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.960874:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2817 00000100:00100000:0.0:1789892691.964415:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892691.964459:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753024 00000100:00100000:2.0:1789892691.964466:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753024 00000100:00100000:2.0:1789892691.964506:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2492 00000100:00100000:2.0:1789892691.964516:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062753024:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892691.964529:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892691.964544:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26045c expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.964568:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.964588:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892691.964597:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383600, rc 0) 00000100:00100000:2.0:1789892691.964640:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753024:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 124us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.964649:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2492 00000100:00100000:2.0:1789892691.965458:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892691.965496:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753152 00000100:00100000:0.0:1789892691.965501:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753152 00000100:00100000:0.0:1789892691.965533:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2493 00000100:00100000:0.0:1789892691.965540:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753152:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.965630:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753152:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 91us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.965635:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2493 00000100:00100000:3.0:1789892691.966279:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892691.966324:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753280 00000100:00100000:0.0:1789892691.966328:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753280 00000100:00100000:0.0:1789892691.966353:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2494 00000100:00100000:0.0:1789892691.966358:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753280:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892691.966440:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753280:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 79us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.966449:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2494 00000100:00100000:2.0:1789892691.967833:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892691.967887:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753408 00000100:00100000:0.0:1789892691.967900:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753408 00000100:00100000:0.0:1789892691.967940:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2495 00000100:00100000:0.0:1789892691.967951:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753408:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892691.967960:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892691.967972:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260463 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.967991:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 10 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.968002:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 10 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892691.968010:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892691.968044:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062753408:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 96us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892691.968052:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2495 00000100:00100000:2.0:1789892691.968644:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892691.968702:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753536 00000100:00100000:3.0:1789892691.968709:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753536 00000100:00100000:3.0:1789892691.968746:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2496 00000100:00100000:3.0:1789892691.968753:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062753536:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892691.968804:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062753536:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 52us (162us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789892691.968810:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2496 00000100:00100000:0.0:1789892691.985811:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055578112:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789892691.985896:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892691.985951:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055578112 00000100:00100000:2.0:1789892691.985959:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055578112 00000100:00100000:2.0:1789892691.986012:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789892691.986021:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055578112:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789892691.986051:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789892691.986109:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082133800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055578112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892691.986114:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1789892691.986160:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055578112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789892692.049858:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789892692.238504:0:218590:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007fffd6f3d990 20000000:00000080:2.0:1789892692.238517:0:218590:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff903090533000 uarg=0000000000000000 00000040:00100000:2.0:1789892692.239058:0:218590:0:(llog.c:1072:llog_reverse_process()) index 189 : idx 181 20000000:01000000:2.0:1789892692.239064:0:218590:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 182 cmd:0xce023 lustre.qpool1 00000040:00080000:2.0:1789892692.239129:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].190, 224 off42864 20000000:01000000:2.0:1789892692.239142:0:218590:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789892692.239152:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].191, 104 off42968 00000040:00080000:2.0:1789892692.239161:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].192, 224 off43192 00000040:00080000:2.0:1789892692.239198:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].218, 224 off48224 20000000:01000000:2.0:1789892692.239211:0:218590:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789892692.239221:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].219, 112 off48336 00000040:00080000:2.0:1789892692.239231:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].220, 224 off48560 00000040:00080000:2.0:1789892692.239268:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].218, 224 off48224 20000000:01000000:2.0:1789892692.239273:0:218590:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce020 lustre qpool1 (null) (null) 00000040:00080000:2.0:1789892692.239281:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].219, 112 off48336 00000040:00080000:2.0:1789892692.239290:0:218590:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].220, 224 off48560 10000000:01000000:2.0:1789892692.239298:0:218590:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789892692.239313:0:218590:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239327:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239333:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239337:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239341:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239346:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239350:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239355:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239367:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239371:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239378:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239382:0:218590:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239387:0:218590:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239418:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239428:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 9 pid: 194990 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239440:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578240:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892692.239516:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239522:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 9 pid: 190664 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239528:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578368:192.168.203.53@tcp:104: 00010000:00010000:2.0:1789892692.239575:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239582:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 23 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239590:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578496:0@lo:104: 00000100:00100000:2.0:1789892692.239632:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892692.239661:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239668:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 23 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239675:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578624:0@lo:104: 00000100:00100000:2.0:1789892692.239730:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892692.239757:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.239760:0:194861:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1789892692.239765:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 23 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239774:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031b1c64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578752:0@lo:104: 00000100:00100000:0.0:1789892692.239780:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055578496 00000100:00100000:1.0:1789892692.239784:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055578624 00000100:00100000:0.0:1789892692.239786:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055578496 00000100:00100000:2.0:1789892692.239792:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.239793:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055578624 00010000:00010000:2.0:1789892692.239819:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239827:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 23 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.239830:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055578752 00000100:00100000:0.0:1789892692.239835:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055578752 00000100:00100000:3.0:1789892692.239851:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 535 00000100:00100000:1.0:1789892692.239863:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 536 00000100:00100000:2.0:1789892692.239866:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578880:0@lo:104: 00000100:00100000:3.0:1789892692.239871:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030a1e75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578496:12345-0@lo:104: 00000100:00100000:1.0:1789892692.239879:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903090531c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578624:12345-0@lo:104: 00000100:00100000:0.0:1789892692.239883:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 537 00010000:00010000:3.0:1789892692.239891:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.239892:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239896:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892692.239899:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578752:12345-0@lo:104: 00010000:00010000:2.0:1789892692.239917:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.239938:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.239945:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 23 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.239958:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579008:0@lo:104: 00010000:00010000:1.0:1789892692.240007:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789892692.240013:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892692.240020:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789892692.240040:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903090531c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578624:12345-0@lo:104: Request processed in 149us (291us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892692.240044:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789892692.240049:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030a1e75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578496:12345-0@lo:104: Request processed in 184us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892692.240052:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 536 00010000:00010000:2.0:1789892692.240054:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.240059:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578752:12345-0@lo:104: Request processed in 163us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892692.240071:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055578880 00000100:00100000:3.0:1789892692.240073:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 535 00010000:00010000:2.0:1789892692.240076:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 23 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.240076:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055578880 00000100:00100000:0.0:1789892692.240083:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 537 00000100:00100000:2.0:1789892692.240093:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579136:0@lo:104: 00000100:00100000:1.0:1789892692.240099:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579008 00000100:00100000:1.0:1789892692.240103:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579008 00000100:00100000:0.0:1789892692.240112:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 538 00000100:00100000:2.0:1789892692.240121:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892692.240125:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218590:x1876835055578880:12345-0@lo:104: 00000100:00100000:1.0:1789892692.240128:0:190653:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579136 00000100:00100000:1.0:1789892692.240131:0:190653:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579136 00010000:00010000:0.0:1789892692.240133:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240144:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240152:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 23 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.240155:0:190653:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 539 00000100:00100000:2.0:1789892692.240168:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579264:0@lo:104: 00000100:00100000:1.0:1789892692.240171:0:190653:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055579008:12345-0@lo:104: 00010000:00010000:0.0:1789892692.240177:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00010000:00010000:1.0:1789892692.240180:0:190653:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.240185:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055578880:12345-0@lo:104: Request processed in 65us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892692.240195:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892692.240199:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 538 00000100:00100000:3.0:1789892692.240210:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579264 00000100:00100000:0.0:1789892692.240220:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 540 00000100:00100000:3.0:1789892692.240222:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579264 00000100:00100000:0.0:1789892692.240229:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055579136:12345-0@lo:104: 00010000:00010000:0.0:1789892692.240236:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240238:0:190653:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00010000:00010000:2.0:1789892692.240241:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.240252:0:190653:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055579008:12345-0@lo:104: Request processed in 82us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.240253:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 541 00000100:00100000:1.0:1789892692.240263:0:190653:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 539 00000100:00100000:3.0:1789892692.240269:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218590:x1876835055579264:12345-0@lo:104: 00010000:00010000:0.0:1789892692.240280:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:3.0:1789892692.240285:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240285:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 23 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.240287:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218590:x1876835055579136:12345-0@lo:104: Request processed in 60us (168us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892692.240289:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789892692.240297:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.240306:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 540 00000100:00100000:2.0:1789892692.240315:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579392:0@lo:104: 00010000:00010000:1.0:1789892692.240316:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e99600 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892692.240323:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240330:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892692.240336:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240344:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789892692.240348:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 10000000:01000000:1.0:1789892692.240351:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892692.240352:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.240353:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.240358:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218590:x1876835055579264:12345-0@lo:104: Request processed in 93us (167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.240373:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 541 00010000:00010000:0.0:1789892692.240376:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892692.240380:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240386:0:218590:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240387:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240388:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579392 00010000:00010000:1.0:1789892692.240389:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240394:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579392 00010000:00010000:2.0:1789892692.240408:0:218590:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 23 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240411:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892692.240411:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240420:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1789892692.240427:0:218590:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579520:0@lo:104: 10000000:01000000:0.0:1789892692.240429:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1789892692.240433:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218590:x1876835055579392:12345-0@lo:104: 00010000:00010000:1.0:1789892692.240435:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.240445:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240446:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e99600/0xd5b980e0d62afa0a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa11 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240453:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.240457:0:218590:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892692.240471:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789892692.240477:0:218590:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36300 going to sleep for 11 seconds 00010000:00010000:1.0:1789892692.240478:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789892692.240484:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240490:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7e00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892692.240491:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892692.240493:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.240499:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789892692.240502:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578496:0@lo:104: 00010000:00010000:0.0:1789892692.240506:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382200/0xd5b980e0d62afa18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa1f expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240513:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd87100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218590:x1876835055579392:12345-0@lo:104: Request processed in 80us (160us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892692.240518:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.240523:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c65180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578624:0@lo:104: 00010000:00010000:0.0:1789892692.240524:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 10000000:00010000:1.0:1789892692.240527:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240531:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.240536:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031b1c64380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578752:0@lo:104: 10000000:01000000:1.0:1789892692.240540:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892692.240550:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e98e00 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:2.0:1789892692.240551:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578880:0@lo:104: 10000000:00010000:0.0:1789892692.240555:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240562:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.240564:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579008:0@lo:104: 00000100:00100000:2.0:1789892692.240579:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579136:0@lo:104: 00010000:00010000:1.0:1789892692.240586:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892692.240590:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240593:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 542 00000100:00100000:2.0:1789892692.240594:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579264:0@lo:104: 10000000:00010000:0.0:1789892692.240606:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240607:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.240612:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579392:0@lo:104: 00000100:00100000:3.0:1789892692.240618:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 10000000:01000000:0.0:1789892692.240625:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892692.240628:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62af9fc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa03 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240638:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789892692.240641:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240645:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc130dc20) 00000100:00100000:3.0:1789892692.240648:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579520 10000000:00010000:1.0:1789892692.240648:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240649:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00000100:00100000:3.0:1789892692.240654:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579520 00010000:00010000:2.0:1789892692.240658:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240660:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240661:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240674:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 543 10000000:00010000:1.0:1789892692.240680:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892692.240685:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892692.240701:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240709:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789892692.240715:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b09fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218590:x1876835055579520:12345-0@lo:104: 00010000:00010000:2.0:1789892692.240716:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c400 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892692.240721:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240721:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.240725:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240744:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892692.240746:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e98e00/0xd5b980e0d62af9ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9f5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240747:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240751:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240771:0:200332:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1789892692.240773:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240777:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62af9e0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9e7 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240777:0:200332:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892692.240782:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892692.240799:0:200332:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:0.0:1789892692.240802:0:200332:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.240805:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1789892692.240805:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240817:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b09fa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218590:x1876835055579520:12345-0@lo:104: Request processed in 102us (362us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892692.240818:0:200332:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240830:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:0.0:1789892692.240837:0:200332:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240839:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 543 00010000:00010000:2.0:1789892692.240850:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240850:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892692.240856:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240870:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c400/0xd5b980e0d62af9d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9d9 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892692.240876:0:200332:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892692.240879:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9c800 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892692.240885:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240892:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240893:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789892692.240899:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892692.240901:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.240902:0:200332:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240921:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903084e9d800 already unused, calling callback (ffffffffc130dc20) 10000000:01000000:1.0:1789892692.240922:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892692.240926:0:200332:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:00010000:2.0:1789892692.240928:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240936:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055579648:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.240938:0:200332:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240943:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.240959:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.240965:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789892692.240965:0:200332:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383200/0xd5b980e0d62af9c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9cb expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240967:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892692.240976:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892692.240981:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.240993:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055580160:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.240996:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892692.240998:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9c800/0xd5b980e0d62af9b6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9bd expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241000:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892692.241006:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892692.241006:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892692.241013:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892692.241017:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789892692.241020:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892692.241021:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892692.241026:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055579776:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892692.241033:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.241042:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789892692.241048:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055580032:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892692.241055:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.241065:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903084e9d800/0xd5b980e0d62af9a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62af9af expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.241066:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892692.241084:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892692.241087:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892692.241091:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892692.241096:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892692.241099:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055580288:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892692.241100:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892692.241110:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892692.241135:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892692.241139:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578240:192.168.203.53@tcp:104: 00000100:00100000:1.0:1789892692.241140:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055580544:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892692.241159:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579648 00000100:00100000:2.0:1789892692.241168:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030a1e74380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055578368:192.168.203.53@tcp:104: 00000100:00100000:0.0:1789892692.241177:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789892692.241181:0:218590:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd85500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218590:1876835055579520:0@lo:104: 00000100:00100000:0.0:1789892692.241186:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055579904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892692.241196:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.241214:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579648 00000100:00100000:0.0:1789892692.241223:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.241233:0:3620:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:3.0:1789892692.241239:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 24 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.241244:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055580672:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892692.241245:0:218590:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.241246:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055580416:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892692.241261:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580160 00000100:00100000:3.0:1789892692.241266:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580160 00010000:00010000:3.0:1789892692.241281:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 25 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.241290:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.241297:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579776 00000100:00100000:3.0:1789892692.241301:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579776 00000100:00100000:0.0:1789892692.241306:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580032 00000100:00100000:0.0:1789892692.241311:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580032 00010000:00010000:3.0:1789892692.241315:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 27 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241328:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 27 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.241330:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580288 00000100:00100000:3.0:1789892692.241336:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580288 00000100:00100000:1.0:1789892692.241336:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580544 00000100:00100000:2.0:1789892692.241341:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055579904 00000100:00100000:1.0:1789892692.241342:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580544 00000100:00100000:2.0:1789892692.241347:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055579904 00010000:00010000:3.0:1789892692.241350:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 29 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.241362:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 30 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.241364:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580672 00010000:00010000:2.0:1789892692.241370:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 30 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.241371:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 587 00000100:00100000:0.0:1789892692.241372:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580672 00000100:00100000:3.0:1789892692.241392:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3621:x1876835055579648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.241396:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 31 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.241400:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 588 00010000:00010000:3.0:1789892692.241402:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892692.241411:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 31 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.241416:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 589 00000100:00100000:1.0:1789892692.241417:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3621:x1876835055580160:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892692.241431:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3618:x1876835055579776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892692.241433:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 31 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892692.241434:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892692.241440:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892692.241442:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 590 00010000:00010000:1.0:1789892692.241443:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 31 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.241450:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 31 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.241457:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+31:3620:x1876835055580032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892692.241458:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc7600/0xd5b980e0d62afa11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa0a expref: 31 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241472:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892692.241474:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 31 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241479:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 30 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.241492:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 30 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.241501:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892692.241509:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9c000/0xd5b980e0d62af9e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9e0 expref: 30 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241512:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 30 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.241533:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3621:x1876835055579648:12345-0@lo:103:ldlm_bl.0 Request processed in 146us (571us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892692.241533:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892692.241535:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9ca00/0xd5b980e0d62afa1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa18 expref: 29 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241542:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6600/0xd5b980e0d62af9f5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9ee expref: 29 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.241550:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 587 00000100:00100000:1.0:1789892692.241565:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3621:x1876835055580160:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (544us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892692.241568:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892692.241585:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789892692.241590:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 588 00000100:00100000:3.0:1789892692.241598:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 591 00000100:00100000:3.0:1789892692.241609:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055580288:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892692.241616:0:193695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 592 00010000:00010000:3.0:1789892692.241617:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892692.241625:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 25 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.241637:0:193695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055580544:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892692.241638:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 25 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.241640:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055579776:12345-0@lo:103:ldlm_bl.0 Request processed in 209us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.241647:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3620:x1876835055580032:12345-0@lo:103:ldlm_bl.0 Request processed in 190us (549us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892692.241652:0:193695:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892692.241664:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 589 00010000:00010000:1.0:1789892692.241665:0:193695:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 25 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.241672:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98c00/0xd5b980e0d62af9d9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9d2 expref: 25 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.241676:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 590 00010000:00010000:1.0:1789892692.241687:0:193695:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 24 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892692.241723:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 593 00000100:00100000:0.0:1789892692.241732:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 594 00010000:00010000:3.0:1789892692.241733:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892692.241738:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055579904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892692.241740:0:193695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98a00/0xd5b980e0d62af9bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9b6 expref: 22 pid: 190663 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.241749:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3620:x1876835055580672:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892692.241751:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892692.241760:0:193695:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892692.241762:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 21 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241765:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892692.241773:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 21 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.241782:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3618:x1876835055580288:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892692.241801:0:193695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:3620:x1876835055580544:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (609us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892692.241805:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 21 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.241811:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 591 00000100:00100000:1.0:1789892692.241826:0:193695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 592 00010000:00010000:0.0:1789892692.241827:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 21 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.241864:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99c00/0xd5b980e0d62afa03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9fc expref: 19 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892692.241888:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383400/0xd5b980e0d62af9af lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9a8 expref: 19 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.241896:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892692.241902:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789892692.241908:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055579648:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892692.241909:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.241932:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055580160:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892692.241957:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3618:x1876835055579904:12345-0@lo:103:ldlm_bl.0 Request processed in 223us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.241964:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580416 00000100:00100000:2.0:1789892692.241969:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 593 00000100:00100000:3.0:1789892692.241970:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580416 00000100:00100000:0.0:1789892692.241970:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3620:x1876835055580672:12345-0@lo:103:ldlm_bl.0 Request processed in 222us (676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.241980:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 594 00000100:00100000:1.0:1789892692.241981:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903082131f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055579776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892692.241990:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 17 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.241995:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055580288:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892692.242018:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 595 00000100:00100000:1.0:1789892692.242019:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055579904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892692.242030:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3618:x1876835055580416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242038:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892692.242040:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:0.0:1789892692.242045:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 16 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.242051:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055580672:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242056:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 16 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.242065:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055580032:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242069:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9dc00/0xd5b980e0d62af9cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62af9c4 expref: 16 pid: 190662 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892692.242080:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055580544:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242081:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892692.242089:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892692.242110:0:193695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753664 00000100:00100000:1.0:1789892692.242115:0:193695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753664 00000100:00100000:0.0:1789892692.242121:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3618:x1876835055580416:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.242122:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753792 00010000:00010000:1.0:1789892692.242129:0:193695:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 10 pid: 194990 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.242130:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753792 00000100:00100000:0.0:1789892692.242130:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 595 00010000:00010000:3.0:1789892692.242151:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 11 pid: 190664 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.242151:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 596 00000100:00100000:0.0:1789892692.242160:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062753664:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242167:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892692.242171:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 11 pid: 194990 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.242184:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 597 00000100:00100000:1.0:1789892692.242184:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ccca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055580416:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242190:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 11 pid: 194990 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.242200:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062753792:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892692.242204:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260463 expref: 11 pid: 194990 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242209:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789892692.242213:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892692.242216:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 10 pid: 190664 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242226:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 10 pid: 190664 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242236:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383600/0xd5b980e0d62afa26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26045c expref: 10 pid: 190664 timeout: 3482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.242242:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062753664:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 84us (205us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892692.242245:0:190655:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892692.242251:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 596 00010000:00010000:3.0:1789892692.242268:0:190655:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242284:0:190655:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242292:0:190655:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242300:0:190655:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242306:0:190655:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242312:0:190655:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382a00 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:3.0:1789892692.242316:0:190655:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242324:0:190655:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.242390:0:218590:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242391:0:190655:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892692.242405:0:218590:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892692.242411:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892692.242413:0:218590:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa34 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892692.242454:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:2397:x1876835062753792:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 258us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.242463:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 597 00000100:00100000:1.0:1789892692.497829:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055580800:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892692.497834:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055581184:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892692.497860:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055581312:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.497920:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892692.497922:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.497934:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055581440:0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.497966:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581312 00000100:00100000:1.0:1789892692.497974:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892692.497978:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055581056:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892692.497987:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055581824:0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.497988:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581312 00000100:00100000:1.0:1789892692.498000:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055581952:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498020:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892692.498029:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.498041:0:192179:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581184 00000100:00100000:1.0:1789892692.498046:0:192179:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581184 00000100:00100000:0.0:1789892692.498052:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055581696:0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.498060:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581440 00000100:00100000:3.0:1789892692.498064:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581440 00000100:00100000:2.0:1789892692.498074:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876835055582336:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498085:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.498096:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581824 00000100:00100000:3.0:1789892692.498100:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581824 00000100:00100000:1.0:1789892692.498104:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1789892692.498111:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876835055582208:0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498119:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876835055581184:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789892692.498120:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.498125:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1789892692.498137:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055581312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498151:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581056 00002000:00000024:1.0:1789892692.498154:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1789892692.498157:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581056 00000100:00100000:2.0:1789892692.498188:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582336 00000100:00100000:2.0:1789892692.498195:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582336 00000100:00100000:0.0:1789892692.498198:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581696 00000100:00100000:3.0:1789892692.498200:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055581312:12345-0@lo:400:kworker.0 Request processed in 67us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498203:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581696 00000100:00100000:3.0:1789892692.498213:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1789892692.498214:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3619:x1876835055581184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498224:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789892692.498228:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1789892692.498237:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1789892692.498238:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1876835055581056:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892692.498246:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 519 00000100:00100000:3.0:1789892692.498250:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055581440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892692.498261:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876835055582336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498261:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000004:00000024:0.0:1789892692.498268:0:190693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445871616 avail 1299632128 00000100:00100000:1.0:1789892692.498273:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055581824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.498282:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055581440:12345-0@lo:400:kworker.0 Request processed in 36us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.498288:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1789892692.498306:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789892692.498310:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789892692.498313:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789892692.498319:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3620:x1876835055582336:12345-0@lo:400:kworker.0 Request processed in 61us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892692.498329:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 519 00000100:00100000:0.0:1789892692.498345:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3619:x1876835055581056:12345-0@lo:41:osp-pre-0-1.0 Request processed in 111us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.498349:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055581824:0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498351:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd86d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055581824:12345-0@lo:400:kworker.0 Request processed in 79us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498371:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00010000:00080000:3.0:1789892692.498372:0:3620:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90309260f800 x1876835055582336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789892692.498372:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1789892692.498384:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3620:1876835055582336:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498397:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789892692.498400:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055581312:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498411:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055581696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498414:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.498442:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876835055582464:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498454:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087cced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055581696:12345-0@lo:400:kworker.0 Request processed in 49us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892692.498457:0:192177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581952 00000100:00100000:0.0:1789892692.498462:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789892692.498464:0:192177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581952 00000100:00100000:1.0:1789892692.498475:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892692.498504:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892692.498510:0:192177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1789892692.498522:0:192177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055581952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498524:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055581440:0@lo:400:kworker.0 00000100:00080000:3.0:1789892692.498526:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789892692.498532:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055580928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892692.498548:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580800 00000100:00100000:3.0:1789892692.498552:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580800 00000100:00100000:1.0:1789892692.498559:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582464 00000100:00100000:0.0:1789892692.498566:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.498573:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582464 00000100:00100000:2.0:1789892692.498576:0:192177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3621:x1876835055581952:12345-0@lo:400:kworker.0 Request processed in 58us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892692.498583:0:192177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:3.0:1789892692.498585:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055580928 00000100:00100000:3.0:1789892692.498595:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055580928 00000100:00100000:0.0:1789892692.498604:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876835055581568:0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498621:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1789892692.498626:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789892692.498631:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892692.498636:0:192179:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1789892692.498636:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876835055582464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.498641:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055580800:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892692.498650:0:192179:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055580928:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892692.498653:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055582080:0@lo:400:kworker.0 00002000:00000024:3.0:1789892692.498659:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:2.0:1789892692.498670:0:192179:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892692.498724:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3621:x1876835055582464:12345-0@lo:400:kworker.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498732:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.498740:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 520 00000100:00100000:3.0:1789892692.498744:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055580800:12345-0@lo:13:osp-pre-0-1.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.498754:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1789892692.498759:0:192179:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055580928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 109us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498759:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876835055582592:0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498761:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055581568 00000100:00100000:1.0:1789892692.498767:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055581568 00000100:00080000:3.0:1789892692.498772:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892692.498775:0:192179:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789892692.498794:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582080 00000100:00100000:0.0:1789892692.498797:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892692.498800:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582080 00000100:00100000:1.0:1789892692.498809:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582592 00000100:00100000:1.0:1789892692.498816:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582592 00000100:00100000:3.0:1789892692.498827:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 521 00000100:00100000:0.0:1789892692.498835:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ccdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055580800:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892692.498837:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 522 00000100:00100000:3.0:1789892692.498851:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876835055581568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892692.498869:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876835055582080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.498872:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055580928:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789892692.498873:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 523 00000100:00100000:1.0:1789892692.498888:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876835055582592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.498907:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+11:3618:x1876835055581568:12345-0@lo:400:kworker.0 Request processed in 70us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498908:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3618:1876835055581568:0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.498918:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 521 00000100:00100000:1.0:1789892692.498924:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3618:x1876835055582592:12345-0@lo:400:kworker.0 Request processed in 38us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892692.498925:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+11:3618:x1876835055582080:12345-0@lo:400:kworker.0 Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892692.498933:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3618:1876835055582080:0@lo:400:kworker.0 00000100:00100000:1.0:1789892692.498936:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 523 00000100:00100000:2.0:1789892692.498945:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 522 00010000:00080000:0.0:1789892692.498960:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9030837e8e00 x1876835055582592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789892692.498972:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3618:1876835055582592:0@lo:400:kworker.0 00000100:00080000:2.0:1789892692.498985:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789892692.499004:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3621:1876835055581952:0@lo:400:kworker.0 00000100:00100000:0.0:1789892692.499013:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892692.499022:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3621:1876835055582464:0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.499050:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582208 00000100:00100000:3.0:1789892692.499055:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582208 00000100:00100000:0.0:1789892692.499055:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055581184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892692.499069:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055581056:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892692.499086:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055581696:0@lo:400:kworker.0 00000100:00100000:3.0:1789892692.499100:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 524 00000100:00100000:3.0:1789892692.499109:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876835055582208:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789892692.499109:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892692.499141:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+8:3619:x1876835055582208:12345-0@lo:400:kworker.0 Request processed in 36us (131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892692.499146:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 524 00000100:00100000:0.0:1789892692.499184:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3619:1876835055582208:0@lo:400:kworker.0 00010000:00010000:0.0:1789892693.073878:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892693.649741:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892693.649749:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 190 10000000:01000000:1.0:1789892693.649755:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892693.649809:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.649820:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.649842:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.649889:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055582720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.649980:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.650026:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.650045:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582720 00000100:00100000:2.0:1789892693.650054:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582720 00000100:00100000:2.0:1789892693.650123:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2497 00000100:00100000:2.0:1789892693.650136:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055582720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.650155:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892693.650178:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa3b expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.650208:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 16 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.650218:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 16 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.650226:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382a00, rc 0) 00000100:00100000:2.0:1789892693.650270:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055582720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.650278:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2497 00000100:00100000:1.0:1789892693.650310:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055582720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.650328:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.650337:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.650397:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055582848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.650423:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.650438:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.650487:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582848 00000100:00100000:0.0:1789892693.650501:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582848 00000100:00100000:0.0:1789892693.650570:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2498 00000100:00100000:0.0:1789892693.650582:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055582848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.650803:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055582848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 223us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.650812:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2498 00000100:00100000:1.0:1789892693.650899:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055582848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.650945:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055582976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.650993:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.651022:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.651038:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055582976 00000100:00100000:0.0:1789892693.651044:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055582976 00000100:00100000:0.0:1789892693.651077:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2499 00000100:00100000:0.0:1789892693.651086:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055582976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.651177:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055582976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.651186:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2499 00000100:00100000:1.0:1789892693.651204:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055582976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.651549:0:218591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218591:1876835055583104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892693.651577:0:218591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.651592:0:218591:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.651651:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583104 00000100:00100000:3.0:1789892693.651657:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583104 00000100:00100000:3.0:1789892693.651706:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2500 00000100:00100000:3.0:1789892693.651714:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218591:x1876835055583104:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.651813:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218591:x1876835055583104:12345-0@lo:502:llog_process_th.0 Request processed in 101us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.651826:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2500 00000100:00100000:1.0:1789892693.651847:0:218591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218591:1876835055583104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892693.651885:0:218591:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218591:1876835055583232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892693.651914:0:218591:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.651933:0:218591:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.651954:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583232 00000100:00100000:2.0:1789892693.651960:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583232 00000100:00100000:2.0:1789892693.651987:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2501 00000100:00100000:2.0:1789892693.651992:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218591:x1876835055583232:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.652099:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218591:x1876835055583232:12345-0@lo:502:llog_process_th.0 Request processed in 102us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.652105:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2501 00000100:00100000:1.0:1789892693.652134:0:218591:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218591:1876835055583232:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892693.652164:0:218591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:2.0:1789892693.652243:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1789892693.652284:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892693.652293:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.652311:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892693.652321:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789892693.652323:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 41 10000000:01000000:2.0:1789892693.652325:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892693.652345:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.652354:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.652363:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892693.652378:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.652403:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.652420:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.652455:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583360 00000100:00100000:0.0:1789892693.652462:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583360 00000100:00100000:0.0:1789892693.652495:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2502 00000100:00100000:0.0:1789892693.652503:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055583360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892693.652525:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892693.652543:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa49 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.652570:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.652584:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.652595:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892693.652641:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055583360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.652651:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2502 00000100:00100000:2.0:1789892693.652672:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.652712:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.652720:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892693.652762:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.652785:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.652814:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.652853:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583488 00000100:00100000:0.0:1789892693.652860:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583488 00000100:00100000:0.0:1789892693.652897:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2503 00000100:00100000:0.0:1789892693.652905:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055583488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.652996:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055583488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 90us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.653006:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2503 00000100:00100000:2.0:1789892693.653022:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.653053:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.653089:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.653104:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff903187f36cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.653145:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583616 00000100:00100000:3.0:1789892693.653153:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583616 00000100:00100000:3.0:1789892693.653183:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2504 00000100:00100000:3.0:1789892693.653190:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055583616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892693.653270:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055583616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 81us (180us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.653277:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2504 00000100:00100000:2.0:1789892693.653303:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892693.654049:0:218592:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 41 00000020:01000000:1.0:1789892693.654120:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 41-40 (rc=0) 10000000:01000000:1.0:1789892693.654164:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892693.654172:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.654180:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892693.654188:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892693.654190:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 190 10000000:01000000:1.0:1789892693.654192:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892693.654210:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.654216:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.654223:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.654233:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.654257:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.654290:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583744 00000100:00100000:1.0:1789892693.654294:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.654296:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583744 00000100:00100000:2.0:1789892693.654327:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2505 00000100:00100000:2.0:1789892693.654332:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055583744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.654339:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892693.654346:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa57 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.654359:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 18 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.654365:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 18 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.654371:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383800, rc 0) 00000100:00100000:2.0:1789892693.654407:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055583744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 75us (148us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.654412:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2505 00000100:00100000:1.0:1789892693.654447:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.654468:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.654476:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.654512:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.654536:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.654551:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.654570:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055583872 00000100:00100000:0.0:1789892693.654576:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055583872 00000100:00100000:0.0:1789892693.654611:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2506 00000100:00100000:0.0:1789892693.654620:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055583872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.654727:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055583872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892693.654739:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055583872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.654745:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2506 00000100:00100000:1.0:1789892693.654769:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.654802:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.654822:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.654846:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584000 00000100:00100000:0.0:1789892693.654852:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584000 00000100:00100000:0.0:1789892693.654882:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2507 00000100:00100000:0.0:1789892693.654891:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055584000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.654967:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055584000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.654976:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2507 00000100:00100000:1.0:1789892693.654983:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.655145:0:218593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218593:1876835055584128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892693.655171:0:218593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.655185:0:218593:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.655209:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584128 00000100:00100000:3.0:1789892693.655214:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584128 00000100:00100000:3.0:1789892693.655241:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2508 00000100:00100000:3.0:1789892693.655247:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218593:x1876835055584128:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.655322:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218593:x1876835055584128:12345-0@lo:502:llog_process_th.0 Request processed in 74us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.655328:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2508 00000100:00100000:1.0:1789892693.655332:0:218593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218593:1876835055584128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892693.655367:0:218593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218593:1876835055584256:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892693.655393:0:218593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.655407:0:218593:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.655427:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584256 00000100:00100000:2.0:1789892693.655435:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584256 00000100:00100000:2.0:1789892693.655482:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2509 00000100:00100000:2.0:1789892693.655491:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218593:x1876835055584256:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.655588:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218593:x1876835055584256:12345-0@lo:502:llog_process_th.0 Request processed in 98us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.655595:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2509 00000100:00100000:1.0:1789892693.655598:0:218593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218593:1876835055584256:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892693.655628:0:218593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:2.0:1789892693.655673:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:2.0:1789892693.655742:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892693.655749:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.655756:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892693.655762:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789892693.655764:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 44 10000000:01000000:2.0:1789892693.655765:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789892693.655780:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.655785:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.655791:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892693.655802:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584384:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.655824:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.655857:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.655885:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584384 00000100:00100000:0.0:1789892693.655892:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584384 00000100:00100000:0.0:1789892693.655926:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2510 00000100:00100000:0.0:1789892693.655935:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055584384:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892693.655945:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892693.655956:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa65 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.655973:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.655984:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.655993:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98e00, rc 0) 00000100:00100000:0.0:1789892693.656033:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055584384:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.656040:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2510 00000100:00100000:2.0:1789892693.656068:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584384:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.656089:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.656096:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892693.656130:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.656165:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.656187:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.656205:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584512 00000100:00100000:0.0:1789892693.656215:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584512 00000100:00100000:0.0:1789892693.656237:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2511 00000100:00100000:0.0:1789892693.656243:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055584512:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.656317:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055584512:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.656326:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2511 00000100:00100000:2.0:1789892693.656335:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584512:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.656369:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584640:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.656414:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.656435:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.656456:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584640 00000100:00100000:3.0:1789892693.656461:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584640 00000100:00100000:3.0:1789892693.656484:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2512 00000100:00100000:3.0:1789892693.656489:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055584640:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892693.656561:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055584640:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.656567:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2512 00000100:00100000:2.0:1789892693.656595:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584640:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789892693.657481:0:218594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 44 00000020:01000000:1.0:1789892693.657576:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 44-43 (rc=0) 10000000:01000000:1.0:1789892693.657597:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892693.657603:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.657611:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892693.657617:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892693.657619:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 190 10000000:01000000:1.0:1789892693.657621:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892693.657636:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.657642:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.657648:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.657659:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.657736:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.657759:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.657771:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584768 00000100:00100000:2.0:1789892693.657781:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584768 00000100:00100000:2.0:1789892693.657829:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2513 00000100:00100000:2.0:1789892693.657853:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055584768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.657863:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892693.657876:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa73 expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.657896:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 20 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.657921:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 20 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.657929:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382e00, rc 0) 00000100:00100000:2.0:1789892693.657977:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055584768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.657987:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2513 00000100:00100000:1.0:1789892693.658007:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.658021:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.658029:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.658072:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.658095:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.658110:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.658130:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055584896 00000100:00100000:0.0:1789892693.658135:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055584896 00000100:00100000:0.0:1789892693.658159:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2514 00000100:00100000:0.0:1789892693.658164:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055584896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.658237:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055584896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 71us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.658245:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2514 00000100:00100000:1.0:1789892693.658255:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055584896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.658279:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.658311:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.658324:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.658348:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585024 00000100:00100000:0.0:1789892693.658353:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585024 00000100:00100000:0.0:1789892693.658382:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2515 00000100:00100000:0.0:1789892693.658389:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055585024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.658458:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055585024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.658465:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2515 00000100:00100000:1.0:1789892693.658468:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.658664:0:218595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218595:1876835055585152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.658751:0:218595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.658784:0:218595:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.658807:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585152 00000100:00100000:3.0:1789892693.658813:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585152 00000100:00100000:3.0:1789892693.658856:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2516 00000100:00100000:3.0:1789892693.658875:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218595:x1876835055585152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.658979:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218595:x1876835055585152:12345-0@lo:502:llog_process_th.0 Request processed in 115us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.658985:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2516 00000100:00100000:2.0:1789892693.659013:0:218595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218595:1876835055585152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.659061:0:218595:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218595:1876835055585280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.659095:0:218595:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.659115:0:218595:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.659139:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585280 00000100:00100000:0.0:1789892693.659144:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585280 00000100:00100000:0.0:1789892693.659169:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2517 00000100:00100000:0.0:1789892693.659175:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218595:x1876835055585280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892693.659249:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218595:x1876835055585280:12345-0@lo:502:llog_process_th.0 Request processed in 72us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.659264:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2517 00000100:00100000:2.0:1789892693.659269:0:218595:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218595:1876835055585280:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892693.659305:0:218595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:1.0:1789892693.659400:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:1.0:1789892693.659417:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892693.659421:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.659428:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892693.659455:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:1.0:1789892693.659457:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 218 10000000:01000000:1.0:1789892693.659459:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892693.659475:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.659480:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.659485:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.659504:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.659529:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.659548:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.659572:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585408 00000100:00100000:0.0:1789892693.659577:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585408 00000100:00100000:0.0:1789892693.659625:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2518 00000100:00100000:0.0:1789892693.659634:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055585408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892693.659641:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892693.659650:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa81 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.659663:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.659670:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.659675:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99000, rc 0) 00000100:00100000:0.0:1789892693.659746:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055585408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.659754:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2518 00000100:00100000:1.0:1789892693.659758:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.659771:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.659779:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.659812:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.659849:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.659887:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.659899:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585536 00000100:00100000:2.0:1789892693.659907:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585536 00000100:00100000:2.0:1789892693.659946:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2519 00000100:00100000:2.0:1789892693.659955:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055585536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.660058:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055585536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.660065:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2519 00000100:00100000:1.0:1789892693.660079:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.660111:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.660159:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.660179:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.660207:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585664 00000100:00100000:3.0:1789892693.660214:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585664 00000100:00100000:3.0:1789892693.660247:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2520 00000100:00100000:3.0:1789892693.660254:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055585664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892693.660333:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055585664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.660341:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2520 00000100:00100000:1.0:1789892693.660346:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055585664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892693.660596:0:218596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218596:1876835055585792:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.660647:0:218596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892693.660665:0:218596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031860b8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.660727:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585792 00000100:00100000:0.0:1789892693.660734:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585792 00000100:00100000:0.0:1789892693.660765:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2521 00000100:00100000:0.0:1789892693.660772:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218596:x1876835055585792:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892693.660910:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218596:x1876835055585792:12345-0@lo:502:llog_process_th.0 Request processed in 140us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.660916:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2521 00000100:00100000:3.0:1789892693.660953:0:218596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218596:1876835055585792:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892693.660980:0:218596:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892693.660990:0:218596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892693.660993:0:218596:0:(obd_config.c:1561:class_process_config()) marker 207 (0x1) lustre-MDT0001-m new lustre.qpool1 00000020:00000080:3.0:1789892693.660997:0:218596:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1789892693.661060:0:218596:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00000100:00100000:3.0:1789892693.661078:0:218596:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218596:1876835055585920:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.661109:0:218596:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892693.661133:0:218596:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031860b8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.661152:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055585920 00000100:00100000:0.0:1789892693.661162:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055585920 00000100:00100000:0.0:1789892693.661186:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2522 00000100:00100000:0.0:1789892693.661192:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218596:x1876835055585920:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892693.661253:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218596:x1876835055585920:12345-0@lo:502:llog_process_th.0 Request processed in 62us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.661259:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2522 00000100:00100000:3.0:1789892693.661287:0:218596:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218596:1876835055585920:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892693.661312:0:218596:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892693.661316:0:218596:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892693.661317:0:218596:0:(obd_config.c:1561:class_process_config()) marker 207 (0x2) lustre-MDT0001-m new lustre.qpool1 00000040:00080000:3.0:1789892693.661324:0:218596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 221 count 217 00000020:01000000:1.0:1789892693.661428:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 218-220 (rc=0) 10000000:01000000:1.0:1789892693.661444:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892693.661450:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.661456:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892693.661470:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892693.661472:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 190 10000000:01000000:1.0:1789892693.661474:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892693.661489:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.661494:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.661500:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.661511:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.661536:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.661555:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.661586:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586048 00000100:00100000:2.0:1789892693.661612:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586048 00000100:00100000:2.0:1789892693.661652:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2523 00000100:00100000:2.0:1789892693.661662:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055586048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.661671:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892693.661713:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa8f expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.661738:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.661752:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 22 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.661761:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382000, rc 0) 00000100:00100000:2.0:1789892693.661823:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055586048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.661847:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2523 00000100:00100000:1.0:1789892693.661854:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.661888:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.661896:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.661928:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.661951:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.661972:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.661986:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586176 00000100:00100000:3.0:1789892693.661992:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586176 00000100:00100000:3.0:1789892693.662021:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2524 00000100:00100000:3.0:1789892693.662028:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055586176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892693.662127:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055586176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 99us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.662134:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2524 00000100:00100000:1.0:1789892693.662136:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.662173:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.662206:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.662220:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.662238:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586304 00000100:00100000:0.0:1789892693.662244:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586304 00000100:00100000:0.0:1789892693.662274:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2525 00000100:00100000:0.0:1789892693.662280:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055586304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.662348:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055586304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.662354:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2525 00000100:00100000:1.0:1789892693.662360:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.662577:0:218597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218597:1876835055586432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.662617:0:218597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.662634:0:218597:0:(client.c:2702:ptlrpc_set_wait()) set ffff903083323480 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.662655:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586432 00000100:00100000:0.0:1789892693.662660:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586432 00000100:00100000:0.0:1789892693.662721:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2526 00000100:00100000:0.0:1789892693.662733:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218597:x1876835055586432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892693.662841:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218597:x1876835055586432:12345-0@lo:502:llog_process_th.0 Request processed in 98us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.662851:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2526 00000100:00100000:2.0:1789892693.662865:0:218597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218597:1876835055586432:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.662905:0:218597:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218597:1876835055586560:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.662934:0:218597:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892693.662957:0:218597:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030823c8e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.662978:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586560 00000100:00100000:0.0:1789892693.662983:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586560 00000100:00100000:0.0:1789892693.663005:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2527 00000100:00100000:0.0:1789892693.663011:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218597:x1876835055586560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892693.663073:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218597:x1876835055586560:12345-0@lo:502:llog_process_th.0 Request processed in 61us (137us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.663085:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2527 00000100:00100000:2.0:1789892693.663093:0:218597:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218597:1876835055586560:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892693.663123:0:218597:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 193 count 189 00000020:01000000:1.0:1789892693.663190:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 190-192 (rc=0) 10000000:01000000:1.0:1789892693.663215:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892693.663220:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.663226:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892693.663232:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892693.663233:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 218 10000000:01000000:1.0:1789892693.663234:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892693.663248:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.663254:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.663259:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.663268:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.663289:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.663304:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892693.663323:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586688 00000100:00100000:3.0:1789892693.663328:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586688 00000100:00100000:3.0:1789892693.663355:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2528 00000100:00100000:3.0:1789892693.663360:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055586688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892693.663368:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892693.663376:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afa9d expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892693.663390:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892693.663396:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892693.663402:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9de00, rc 0) 00000100:00100000:3.0:1789892693.663434:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055586688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 74us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.663439:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2528 00000100:00100000:1.0:1789892693.663472:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.663489:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.663495:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.663525:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.663547:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.663583:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.663609:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586816 00000100:00100000:2.0:1789892693.663617:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586816 00000100:00100000:2.0:1789892693.663651:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2529 00000100:00100000:2.0:1789892693.663659:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055586816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.663820:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055586816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 160us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892693.663827:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.663850:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2529 00000100:00100000:1.0:1789892693.663866:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.663902:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.663922:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.663938:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055586944 00000100:00100000:0.0:1789892693.663942:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055586944 00000100:00100000:0.0:1789892693.663968:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2530 00000100:00100000:0.0:1789892693.663972:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055586944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.664033:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055586944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.664040:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2530 00000100:00100000:1.0:1789892693.664047:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055586944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892693.664250:0:218598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218598:1876835055587072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.664304:0:218598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892693.664329:0:218598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9031860b8c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.664351:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055587072 00000100:00100000:0.0:1789892693.664356:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055587072 00000100:00100000:0.0:1789892693.664379:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2531 00000100:00100000:0.0:1789892693.664384:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218598:x1876835055587072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892693.664457:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218598:x1876835055587072:12345-0@lo:502:llog_process_th.0 Request processed in 73us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.664463:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2531 00000100:00100000:3.0:1789892693.664497:0:218598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218598:1876835055587072:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892693.664523:0:218598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789892693.664529:0:218598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892693.664530:0:218598:0:(obd_config.c:1561:class_process_config()) marker 206 (0x1) lustre-MDT0000-m new lustre.qpool1 00000020:00000080:3.0:1789892693.664534:0:218598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce020 00020000:01000000:3.0:1789892693.664564:0:218598:0:(lod_pool.c:475:lod_pool_new()) qpool1 is pool #1 00080000:10000000:3.0:1789892693.665321:0:218598:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5c:0x0] (8/32) registered 00080000:10000000:3.0:1789892693.666634:0:218598:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5d:0x0] (8/32) registered 00080000:10000000:3.0:1789892693.667487:0:218598:0:(osd_handler.c:5582:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x5e:0x0] (8/32) registered 00000100:00100000:3.0:1789892693.668162:0:218598:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218598:1876835055587200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892693.668201:0:218598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892693.668235:0:218598:0:(client.c:2702:ptlrpc_set_wait()) set ffff9030834def00 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.668249:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055587200 00000100:00100000:2.0:1789892693.668256:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055587200 00000100:00100000:2.0:1789892693.668296:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2532 00000100:00100000:2.0:1789892693.668305:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218598:x1876835055587200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892693.668408:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218598:x1876835055587200:12345-0@lo:502:llog_process_th.0 Request processed in 104us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.668418:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2532 00000100:00100000:3.0:1789892693.668437:0:218598:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218598:1876835055587200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789892693.668464:0:218598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789892693.668470:0:218598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789892693.668473:0:218598:0:(obd_config.c:1561:class_process_config()) marker 206 (0x2) lustre-MDT0000-m new lustre.qpool1 00000040:00080000:3.0:1789892693.668477:0:218598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 221 count 217 00000020:01000000:1.0:1789892693.668529:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 218-220 (rc=0) 10000000:01000000:1.0:1789892693.668553:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892693.668560:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.668567:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892693.668573:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892693.668575:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:1.0:1789892693.668577:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892693.668593:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.668608:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.668614:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.668626:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055587328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.668654:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.668671:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892693.668731:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055587328 00000100:00100000:2.0:1789892693.668738:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055587328 00000100:00100000:2.0:1789892693.668776:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2533 00000100:00100000:2.0:1789892693.668785:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055587328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892693.668795:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892693.668809:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afaab expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.668844:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.668856:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892693.668879:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382600, rc 0) 00000100:00100000:2.0:1789892693.668923:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055587328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.668933:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2533 00000100:00100000:1.0:1789892693.668950:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055587328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892693.668964:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.668971:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892693.669004:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055587456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892693.669027:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892693.669048:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892693.669076:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055587456 00000100:00100000:0.0:1789892693.669083:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055587456 00000100:00100000:0.0:1789892693.669118:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2534 00000100:00100000:0.0:1789892693.669126:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055587456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.669198:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319853f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055587456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 72us (168us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892693.669207:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2534 00000100:00100000:1.0:1789892693.669218:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055587456:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789892693.669240:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892693.669245:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892693.669251:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892693.755766:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892693.755841:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062753920 00000100:00100000:0.0:1789892693.755854:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062753920 00000100:00100000:0.0:1789892693.755927:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2535 00000100:00100000:0.0:1789892693.755940:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062753920:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892693.755969:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892693.755986:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26046a expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.756011:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.756020:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892693.756027:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892693.756082:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062753920:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 148us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.756088:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2535 00000100:00100000:0.0:1789892693.757098:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892693.757161:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754048 00000100:00100000:2.0:1789892693.757171:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754048 00000100:00100000:2.0:1789892693.757226:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2536 00000100:00100000:2.0:1789892693.757239:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062754048:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892693.757418:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062754048:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 182us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.757429:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2536 00000100:00100000:2.0:1789892693.758269:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892693.758321:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754176 00000100:00100000:0.0:1789892693.758329:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754176 00000100:00100000:0.0:1789892693.758371:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2537 00000100:00100000:0.0:1789892693.758380:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062754176:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.758470:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062754176:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 91us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.758477:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2537 00000100:00100000:3.0:1789892693.759505:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892693.759557:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754304 00000100:00100000:0.0:1789892693.759562:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754304 00000100:00100000:0.0:1789892693.759599:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2538 00000100:00100000:0.0:1789892693.759607:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217210:x1876835062754304:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789892693.759728:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217210:x1876835062754304:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 120us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892693.759733:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2538 00000100:00100000:3.0:1789892693.760488:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892693.760529:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754432 00000100:00100000:2.0:1789892693.760534:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754432 00000100:00100000:2.0:1789892693.760563:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2539 00000100:00100000:2.0:1789892693.760570:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217210:x1876835062754432:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789892693.760655:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217210:x1876835062754432:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 85us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892693.760661:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2539 00000100:00100000:2.0:1789892693.761530:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892693.761634:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754560 00000100:00100000:3.0:1789892693.761640:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754560 00000100:00100000:3.0:1789892693.761702:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2540 00000100:00100000:3.0:1789892693.761710:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062754560:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892693.761719:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892693.761737:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260471 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892693.761776:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 10 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892693.761787:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 10 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892693.761794:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9da00, rc 0) 00000100:00100000:3.0:1789892693.761824:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062754560:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 115us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892693.761842:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2540 00000100:00100000:3.0:1789892693.762502:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892693.762542:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754688 00000100:00100000:0.0:1789892693.762549:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754688 00000100:00100000:0.0:1789892693.762584:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2541 00000100:00100000:0.0:1789892693.762593:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062754688:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892693.762675:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062754688:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 83us (172us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892693.762702:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2541 00000100:00100000:2.0:1789892694.033916:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055587584:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789892694.033979:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892694.034050:0:192180:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055587584 00000100:00100000:3.0:1789892694.034058:0:192180:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055587584 00000100:00080000:2.0:1789892694.034117:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892694.034160:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789892694.034172:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055587584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789892694.034198:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892694.034243:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3619:x1876835055587584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892694.034250:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1789892694.034281:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3619:1876835055587584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789892694.097823:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892694.715564:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:0.0:1789892694.715621:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892694.715640:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754816 00000100:00100000:3.0:1789892694.715655:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754816 00000100:00100000:1.0:1789892694.715704:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062754944 00000100:00100000:1.0:1789892694.715712:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062754944 00000100:00080000:2.0:1789892694.715772:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789892694.715773:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892694.715785:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2542 00000100:00100000:1.0:1789892694.715798:0:197539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755072 00000100:00100000:3.0:1789892694.715803:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062754816:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892694.715805:0:197539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755072 00000100:00100000:2.0:1789892694.715816:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 525 00000100:00100000:2.0:1789892694.715848:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2396:x1876835062754944:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:1.0:1789892694.715880:0:197539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 526 00000100:00100000:1.0:1789892694.715890:0:197539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062755072:12345-192.168.203.53@tcp:400:kworker.0 00000100:00100000:3.0:1789892694.715943:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:2397:x1876835062754816:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 148us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892694.715956:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:2396:x1876835062754944:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 127us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892694.715956:0:197539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_005:3400b0a6-c22f-4041-a424-3221ecd8e600+5:2397:x1876835062755072:12345-192.168.203.53@tcp:400:kworker.0 Request processed in 65us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892694.715988:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2542 00000100:00100000:1.0:1789892694.715989:0:197539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 526 00000100:00100000:2.0:1789892694.715996:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 525 00000100:00080000:2.0:1789892694.716028:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000020:00000080:1.0:1789892694.903008:0:218695:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c00866bc len=0 uarg=00007ffc4a8e3ca0 20000000:00000080:1.0:1789892694.903029:0:218695:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=c00866bc len=576 karg=ffff90308597d400 uarg=0000000000000000 00000040:00100000:1.0:1789892694.903731:0:218695:0:(llog.c:1072:llog_reverse_process()) index 192 : idx 181 20000000:01000000:1.0:1789892694.903739:0:218695:0:(mgs_llog.c:963:mgs_search_pool_cb()) Matched pool rec 191 cmd:0xce020 lustre.qpool1 00000040:00080000:1.0:1789892694.903859:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].193, 224 off43416 20000000:01000000:1.0:1789892694.903880:0:218695:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892694.903893:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].194, 128 off43544 00000040:00080000:1.0:1789892694.903904:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].195, 224 off43768 00000040:00080000:1.0:1789892694.903949:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].221, 224 off48784 20000000:01000000:1.0:1789892694.903954:0:218695:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892694.903964:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].222, 136 off48920 00000040:00080000:1.0:1789892694.903982:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].224, 224 off49376 00000040:00080000:1.0:1789892694.904022:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].221, 224 off48784 20000000:01000000:1.0:1789892694.904027:0:218695:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xce021 lustre qpool1 lustre-OST0001_UUID (null) 00000040:00080000:1.0:1789892694.904036:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].222, 136 off48920 00000040:00080000:1.0:1789892694.904050:0:218695:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].224, 224 off49376 10000000:01000000:1.0:1789892694.904057:0:218695:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789892694.904079:0:218695:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904103:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904109:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904124:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904129:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904133:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904138:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904142:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904146:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904150:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904158:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904170:0:218695:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904176:0:218695:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904217:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 9 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904229:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 9 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904254:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055587712:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892694.904353:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904360:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 9 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904367:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055587840:192.168.203.53@tcp:104: 00010000:00010000:1.0:1789892694.904392:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904399:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 23 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904407:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055587968:0@lo:104: 00000100:00100000:1.0:1789892694.904447:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892694.904482:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 23 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904489:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 23 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904497:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588096:0@lo:104: 00000100:00100000:3.0:1789892694.904503:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055587968 00000100:00100000:1.0:1789892694.904519:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892694.904520:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055587968 00000100:00100000:2.0:1789892694.904553:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588096 00010000:00010000:1.0:1789892694.904555:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.904560:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588096 00010000:00010000:1.0:1789892694.904571:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 23 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904581:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588224:0@lo:104: 00000100:00100000:1.0:1789892694.904600:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892694.904630:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.904632:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588224 00000100:00100000:2.0:1789892694.904638:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588224 00010000:00010000:1.0:1789892694.904643:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 23 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.904644:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789892694.904660:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588352:0@lo:104: 00000100:00100000:3.0:1789892694.904668:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588096:12345-0@lo:104: 00000100:00100000:0.0:1789892694.904675:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1789892694.904716:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892694.904733:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 546 00010000:00010000:3.0:1789892694.904734:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904749:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.904752:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588224:12345-0@lo:104: 00000100:00100000:0.0:1789892694.904769:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055587968:12345-0@lo:104: 00010000:00010000:2.0:1789892694.904778:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904793:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 23 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904805:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ce9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588480:0@lo:104: 00010000:00010000:0.0:1789892694.904809:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.904838:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789892694.904861:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588096:12345-0@lo:104: Request processed in 201us (340us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892694.904869:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789892694.904876:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 544 00000100:00100000:1.0:1789892694.904878:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892694.904882:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588224:12345-0@lo:104: Request processed in 135us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892694.904892:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 546 00000100:00100000:3.0:1789892694.904919:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588352 00000100:00100000:2.0:1789892694.904919:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588480 00000100:00100000:3.0:1789892694.904927:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588352 00000100:00100000:2.0:1789892694.904928:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588480 00010000:00010000:1.0:1789892694.904928:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.904943:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 23 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.904955:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588608:0@lo:104: 00000100:00100000:1.0:1789892694.904979:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892694.904989:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1789892694.905006:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905018:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 23 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.905021:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055587968:12345-0@lo:104: Request processed in 284us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892694.905033:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588736:0@lo:104: 00000100:00100000:2.0:1789892694.905043:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 547 00000100:00100000:3.0:1789892694.905051:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588608 00000100:00100000:3.0:1789892694.905058:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588608 00000100:00100000:2.0:1789892694.905061:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588480:12345-0@lo:104: 00000100:00100000:0.0:1789892694.905066:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 545 00000100:00100000:1.0:1789892694.905074:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892694.905082:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.905102:0:191419:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1789892694.905102:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 23 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.905113:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588736 00010000:00010000:1.0:1789892694.905117:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 23 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.905120:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588736 00000100:00100000:1.0:1789892694.905133:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ce9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588864:0@lo:104: 00000100:00100000:0.0:1789892694.905140:0:190654:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 548 00010000:00010000:2.0:1789892694.905156:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789892694.905157:0:190654:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:218695:x1876835055588352:12345-0@lo:104: 00000100:00100000:1.0:1789892694.905167:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892694.905172:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 549 00000100:00100000:2.0:1789892694.905178:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ce9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:218695:x1876835055588480:12345-0@lo:104: Request processed in 123us (299us total) trans 0 rc 0/0 00010000:00010000:0.0:1789892694.905190:0:190654:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.905196:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:218695:x1876835055588608:12345-0@lo:104: 00000100:00100000:2.0:1789892694.905196:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 547 00010000:00010000:1.0:1789892694.905197:0:218695:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 23 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.905217:0:194861:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588864 00010000:00010000:3.0:1789892694.905220:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.905227:0:194861:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588864 00010000:00010000:1.0:1789892694.905235:0:218695:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 23 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.905248:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 550 00000100:00100000:2.0:1789892694.905266:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309190d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:218695:x1876835055588736:12345-0@lo:104: 00010000:00010000:2.0:1789892694.905280:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.905283:0:218695:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588992:0@lo:104: 00010000:00010000:3.0:1789892694.905314:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1789892694.905324:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ceb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+6:218695:x1876835055588608:12345-0@lo:104: Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892694.905334:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 549 00000100:00100000:1.0:1789892694.905348:0:218695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789892694.905349:0:190654:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00010000:00010000:2.0:1789892694.905352:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789892694.905362:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309190d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588736:12345-0@lo:104: Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892694.905368:0:191419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055588992 00000100:00100000:1.0:1789892694.905370:0:218695:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892694.905373:0:190654:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ce8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588352:12345-0@lo:104: Request processed in 213us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892694.905376:0:191419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055588992 00000100:00100000:2.0:1789892694.905376:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 550 00000100:00100000:0.0:1789892694.905395:0:190654:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 548 00000100:00100000:1.0:1789892694.905399:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055587968:0@lo:104: 00000100:00100000:2.0:1789892694.905405:0:194861:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 551 00000100:00100000:2.0:1789892694.905417:0:194861:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+5:218695:x1876835055588864:12345-0@lo:104: 00000100:00100000:1.0:1789892694.905421:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3a300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588096:0@lo:104: 00000100:00100000:3.0:1789892694.905427:0:191419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 552 00010000:00010000:2.0:1789892694.905427:0:194861:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.905438:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309e3c3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588224:0@lo:104: 00000100:00100000:1.0:1789892694.905457:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cea300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588352:0@lo:104: 00000100:00100000:1.0:1789892694.905477:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ce9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588480:0@lo:104: 00010000:00010000:2.0:1789892694.905486:0:194861:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1789892694.905496:0:194861:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ce9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218695:x1876835055588864:12345-0@lo:104: Request processed in 81us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892694.905498:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cead80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588608:0@lo:104: 00000100:00100000:1.0:1789892694.905516:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cea680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588736:0@lo:104: 00000100:00100000:2.0:1789892694.905526:0:194861:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 551 00000100:00100000:3.0:1789892694.905531:0:191419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+4:218695:x1876835055588992:12345-0@lo:104: 00000100:00100000:1.0:1789892694.905540:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ce9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588864:0@lo:104: 00010000:00010000:3.0:1789892694.905546:0:191419:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905561:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1789892694.905568:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905581:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6e00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892694.905588:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905590:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789892694.905598:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905605:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905607:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6200 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892694.905613:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892694.905620:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905623:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.905628:0:191419:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:3.0:1789892694.905641:0:191419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ceb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+3:218695:x1876835055588992:12345-0@lo:104: Request processed in 118us (295us total) trans 0 rc 0/0 10000000:01000000:2.0:1789892694.905642:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:1.0:1789892694.905644:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.905659:0:191419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 552 10000000:01000000:1.0:1789892694.905668:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789892694.905723:0:190658:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789892694.905732:0:190658:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905781:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.905782:0:190658:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7000 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:1.0:1789892694.905791:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.905797:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 10000000:00010000:0.0:1789892694.905797:0:190658:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905804:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789892694.905812:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905819:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892694.905848:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905849:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.905852:0:190658:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905878:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6e00/0xd5b980e0d62afa9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afaa4 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905888:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afa8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa96 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789892694.905913:0:190658:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.905920:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1789892694.905928:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7800 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:2.0:1789892694.905930:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905933:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 10000000:00010000:3.0:1789892694.905941:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905944:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789892694.905963:0:190658:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789892694.905964:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d382400 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892694.905972:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.905984:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7a00 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:3.0:1789892694.905988:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892694.905989:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789892694.906018:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906021:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906022:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.906023:0:190658:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789892694.906063:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:2.0:1789892694.906067:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892694.906068:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.906082:0:190658:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:2.0:1789892694.906096:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892694.906097:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892694.906098:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892694.906111:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892694.906126:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.906127:0:190658:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906128:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.906136:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906141:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892694.906154:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906178:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892694.906195:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afa65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa6c expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.906199:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7800/0xd5b980e0d62afa73 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa7a expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906200:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.906200:0:190658:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7000/0xd5b980e0d62afaab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afab2 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906204:0:200331:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789892694.906214:0:200331:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906244:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afa81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa88 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906260:0:200331:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7e00 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:2.0:1789892694.906266:0:200331:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.906270:0:191824:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789892694.906271:0:190659:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789892694.906283:0:190659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.906285:0:191824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906305:0:200331:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906317:0:190659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc7400 already unused, calling callback (ffffffffc130dc20) 00010000:00010000:0.0:1789892694.906320:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892694.906325:0:191824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90319d383000 already unused, calling callback (ffffffffc130dc20) 10000000:00010000:1.0:1789892694.906325:0:190659:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789892694.906329:0:200331:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.906330:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1789892694.906334:0:191824:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906337:0:190659:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.906338:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789892694.906364:0:200331:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789892694.906365:0:191824:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789892694.906367:0:190659:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906387:0:200331:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892694.906388:0:190659:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:00010000:3.0:1789892694.906390:0:191824:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.906410:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:1.0:1789892694.906413:0:190659:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906420:0:200331:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 10000000:01000000:3.0:1789892694.906430:0:191824:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789892694.906432:0:190659:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892694.906435:0:200331:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906442:0:190659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906446:0:200331:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7e00/0xd5b980e0d62afa57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa5e expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906450:0:190659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62afa3b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa42 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.906461:0:191824:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906471:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789892694.906476:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892694.906484:0:191824:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789892694.906487:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892694.906493:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892694.906494:0:191824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.906498:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892694.906498:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00010000:00010000:2.0:1789892694.906501:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789892694.906503:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789892694.906517:0:191824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.153@tcp lock: ffff90319d383000/0xd5b980e0d62afa49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd5b980e0d62afa50 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.906519:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055589120:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892694.906564:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055589376:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892694.906566:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789892694.906566:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789892694.906575:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892694.906577:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055587712:192.168.203.53@tcp:104: 00010000:00010000:3.0:1789892694.906582:0:191824:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789892694.906603:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd39500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055587840:192.168.203.53@tcp:104: 00000100:00100000:2.0:1789892694.906619:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055589632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892694.906625:0:218695:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:218695:1876835055588992:0@lo:104: 00000100:00100000:3.0:1789892694.906627:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055589504:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892694.906644:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892694.906710:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755200 00000100:00100000:2.0:1789892694.906718:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755200 00000100:00100000:3.0:1789892694.906744:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789892694.906744:0:218695:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.906752:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 10 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.906782:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055589888:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892694.906788:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755328 00000100:00100000:2.0:1789892694.906793:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755328 00000100:00100000:3.0:1789892694.906795:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055590016:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892694.906802:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589120 00000100:00100000:1.0:1789892694.906808:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589120 00010000:00010000:2.0:1789892694.906809:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 11 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.906842:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589376 00010000:00010000:1.0:1789892694.906848:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 24 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.906856:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892694.906857:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589376 00000100:00100000:3.0:1789892694.906870:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055589248:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892694.906881:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 25 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.906885:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589504 00000100:00100000:1.0:1789892694.906893:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589504 00000100:00100000:2.0:1789892694.906908:0:190656:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589888 00000100:00100000:2.0:1789892694.906912:0:190656:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589888 00010000:00010000:1.0:1789892694.906916:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 26 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.906931:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789892694.906936:0:190656:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 27 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.906946:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589248 00000100:00100000:1.0:1789892694.906952:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589248 00000100:00100000:3.0:1789892694.906969:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055589760:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892694.906970:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 598 00010000:00010000:1.0:1789892694.906972:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 28 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.906988:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 599 00000100:00100000:0.0:1789892694.906996:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2396:x1876835062755200:12345-192.168.203.53@tcp:103:ldlm_bl.0 00000100:00100000:2.0:1789892694.907014:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+11:2397:x1876835062755328:12345-192.168.203.53@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789892694.907015:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789892694.907016:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 600 00000100:00100000:3.0:1789892694.907017:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892694.907035:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+28:3620:x1876835055589120:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892694.907035:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 11 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.907039:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789892694.907054:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x60000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 11 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.907055:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789892694.907066:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 28 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.907078:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589760 00010000:00010000:0.0:1789892694.907085:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 11 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.907088:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589760 00010000:00010000:2.0:1789892694.907109:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x50000400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 11 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.907114:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 29 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.907121:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 29 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.907151:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99200/0xd5b980e0d62afab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 16 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26046a expref: 11 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.907153:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 601 00010000:00010000:2.0:1789892694.907158:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9da00/0xd5b980e0d62afac0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 17 type: PLN flags: 0x44801400000020 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260471 expref: 11 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.907162:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e9de00/0xd5b980e0d62afaa4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 18 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa9d expref: 29 pid: 190664 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.907177:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+29:3618:x1876835055589376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892694.907204:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892694.907222:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 15 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 29 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.907239:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 28 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.907251:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892694.907253:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892694.907253:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789892694.907264:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382600/0xd5b980e0d62afab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afaab expref: 28 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.907291:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892694.907316:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2397:x1876835062755328:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 303us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892694.907325:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3620:x1876835055589120:12345-0@lo:103:ldlm_bl.0 Request processed in 286us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892694.907325:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ccca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:2396:x1876835062755200:12345-192.168.203.53@tcp:103:ldlm_bl.0 Request processed in 322us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892694.907334:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 599 00000100:00100000:3.0:1789892694.907349:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903082131f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3618:x1876835055589376:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892694.907362:0:190656:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 602 00000100:00100000:1.0:1789892694.907374:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 600 00000100:00100000:2.0:1789892694.907375:0:190656:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+27:3619:x1876835055589504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892694.907385:0:190656:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789892694.907386:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 598 00010000:00010000:2.0:1789892694.907394:0:190656:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 26 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.907399:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 601 00000100:00100000:1.0:1789892694.907411:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 603 00010000:00010000:2.0:1789892694.907418:0:190656:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 26 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.907432:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+25:3618:x1876835055589888:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789892694.907438:0:190656:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afa7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa73 expref: 25 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.907443:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1789892694.907448:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 604 00010000:00010000:2.0:1789892694.907450:0:190656:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892694.907452:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 24 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.907466:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 24 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.907473:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3621:x1876835055589248:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892694.907483:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 605 00010000:00010000:1.0:1789892694.907484:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d383800/0xd5b980e0d62afa5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa57 expref: 24 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.907486:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892694.907494:0:190656:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3619:x1876835055589504:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (754us total) trans 0 rc 0/0 00010000:00010000:3.0:1789892694.907501:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 24 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.907514:0:190656:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 602 00010000:00010000:1.0:1789892694.907514:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789892694.907520:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309260c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:3621:x1876835055589760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892694.907521:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 23 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.907545:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892694.907553:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382000/0xd5b980e0d62afa96 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa8f expref: 22 pid: 194990 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.907557:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 22 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.907566:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:3618:x1876835055589888:12345-0@lo:103:ldlm_bl.0 Request processed in 138us (715us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892694.907599:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 603 00010000:00010000:0.0:1789892694.907610:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 21 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.907623:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892694.907635:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99000/0xd5b980e0d62afa88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa81 expref: 20 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.907657:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789892694.907665:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892694.907771:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030837e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3621:x1876835055589248:12345-0@lo:103:ldlm_bl.0 Request processed in 306us (845us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892694.907776:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055590144:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789892694.907788:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 604 00000100:00100000:0.0:1789892694.907788:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309260c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3621:x1876835055589760:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892694.907810:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 605 00000100:00100000:2.0:1789892694.907820:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892694.907849:0:190655:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055589632 00000100:00100000:3.0:1789892694.907856:0:190655:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055589632 00000100:00100000:0.0:1789892694.907870:0:202163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590144 00000100:00100000:1.0:1789892694.907872:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055589376:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789892694.907881:0:202163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590144 00010000:00010000:3.0:1789892694.907882:0:190655:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 18 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.907888:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd87100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055589120:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892694.907907:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9031ba327800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055589888:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892694.907915:0:202163:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 19 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892694.907929:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892694.907934:0:190655:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 606 00000100:00100000:3.0:1789892694.907949:0:190655:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9031b1c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:3620:x1876835055589632:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789892694.907959:0:190657:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590016 00000100:00100000:1.0:1789892694.907966:0:190657:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590016 00000100:00100000:0.0:1789892694.907970:0:202163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 607 00010000:00010000:3.0:1789892694.907975:0:190655:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892694.907985:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837ea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055589504:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892694.907987:0:190655:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 20 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.907988:0:190657:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 20 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.907995:0:202163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089fe9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3620:x1876835055590144:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892694.908029:0:202163:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789892694.908038:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ce9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055589248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789892694.908039:0:190655:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 20 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.908045:0:202163:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 20 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.908046:0:190657:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 608 00000100:00100000:1.0:1789892694.908068:0:190657:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030835d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:3619:x1876835055590016:12345-0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789892694.908071:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ce8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3621:1876835055589760:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892694.908090:0:190657:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789892694.908098:0:190655:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e98e00/0xd5b980e0d62afa6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa65 expref: 20 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908098:0:190657:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 20 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.908101:0:202163:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 20 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908151:0:190657:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 19 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892694.908167:0:190655:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789892694.908169:0:202163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afa50 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa49 expref: 19 pid: 190662 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908174:0:190657:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90319d382a00/0xd5b980e0d62afa42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd5b980e0d62afa3b expref: 19 pid: 190663 timeout: 3485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908187:0:190657:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908196:0:190657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892694.908204:0:202163:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789892694.908208:0:190657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908216:0:190657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.908224:0:190655:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9031b1c65180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:3620:x1876835055589632:12345-0@lo:103:ldlm_bl.0 Request processed in 279us (559us total) trans 0 rc 0/0 00010000:00010000:1.0:1789892694.908242:0:190657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789892694.908246:0:190655:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 606 00000100:00100000:2.0:1789892694.908254:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309fd84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055589632:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892694.908256:0:190657:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.908266:0:202163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089fe9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:3620:x1876835055590144:12345-0@lo:103:ldlm_bl.0 Request processed in 277us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892694.908283:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9030837eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3620:1876835055590144:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789892694.908289:0:190657:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff903090bc6800 already unused, calling callback (ffffffffc0d27250) 00010000:00010000:1.0:1789892694.908301:0:190657:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892694.908312:0:202163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 607 00010000:00010000:1.0:1789892694.908315:0:190657:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908331:0:190657:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892694.908340:0:190657:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789892694.908355:0:218695:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892694.908366:0:218695:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.908379:0:190657:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030835d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:3619:x1876835055590016:12345-0@lo:103:ldlm_bl.0 Request processed in 317us (455us total) trans 0 rc 0/0 00010000:00010000:2.0:1789892694.908389:0:218695:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff903090bc6800/0xd5b980e0d62afac7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 218695 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892694.908391:0:190657:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 608 00000100:00100000:3.0:1789892694.908416:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087ceaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3619:1876835055590016:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789892695.121949:0:190658:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789892695.505747:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892695.505756:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903083869000 from 193 10000000:01000000:1.0:1789892695.505762:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892695.505833:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.505845:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.505856:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.505897:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.505973:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.506016:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.506039:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590272 00000100:00100000:2.0:1789892695.506050:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590272 00000100:00100000:2.0:1789892695.506111:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2543 00000100:00100000:2.0:1789892695.506121:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+15:190667:x1876835055590272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892695.506137:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892695.506150:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afad5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62aface expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.506175:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62aface expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.506185:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d382e00/0xd5b980e0d62afad5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62aface expref: 16 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.506194:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d382e00, rc 0) 00000100:00100000:2.0:1789892695.506236:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055590272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.506242:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2543 00000100:00100000:1.0:1789892695.506275:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.506294:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afad5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.506307:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afad5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.506371:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.506392:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.506407:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.506470:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590400 00000100:00100000:3.0:1789892695.506476:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590400 00000100:00100000:3.0:1789892695.506511:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2544 00000100:00100000:3.0:1789892695.506518:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055590400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.506672:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055590400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 155us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.506708:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2544 00000100:00100000:1.0:1789892695.506718:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.506772:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.506809:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.506845:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.506854:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590528 00000100:00100000:0.0:1789892695.506859:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590528 00000100:00100000:0.0:1789892695.506888:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2545 00000100:00100000:0.0:1789892695.506895:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055590528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.506983:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055590528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 88us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.506990:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2545 00000100:00100000:1.0:1789892695.507006:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.507272:0:218696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218696:1876835055590656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.507305:0:218696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.507320:0:218696:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.507343:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590656 00000100:00100000:0.0:1789892695.507348:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590656 00000100:00100000:0.0:1789892695.507373:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2546 00000100:00100000:0.0:1789892695.507378:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218696:x1876835055590656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.507457:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218696:x1876835055590656:12345-0@lo:502:llog_process_th.0 Request processed in 77us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.507464:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2546 00000100:00100000:2.0:1789892695.507489:0:218696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218696:1876835055590656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.507530:0:218696:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218696:1876835055590784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.507559:0:218696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.507574:0:218696:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563f540 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.507597:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590784 00000100:00100000:0.0:1789892695.507601:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590784 00000100:00100000:0.0:1789892695.507623:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2547 00000100:00100000:0.0:1789892695.507628:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218696:x1876835055590784:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.507749:0:218696:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218696:1876835055590784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.507751:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:218696:x1876835055590784:12345-0@lo:502:llog_process_th.0 Request processed in 121us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.507766:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2547 00000040:00080000:2.0:1789892695.507768:0:218696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:1.0:1789892695.507875:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:1.0:1789892695.507901:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892695.507907:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afad5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.507915:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7400/0xd5b980e0d62aface lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afad5 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.507928:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1789892695.507930:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 41 10000000:01000000:1.0:1789892695.507932:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789892695.507944:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.507949:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.507955:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.507963:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.507986:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.508009:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.508032:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055590912 00000100:00100000:3.0:1789892695.508037:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055590912 00000100:00100000:3.0:1789892695.508060:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2548 00000100:00100000:3.0:1789892695.508066:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+16:190667:x1876835055590912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892695.508073:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892695.508086:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c200/0xd5b980e0d62afae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afadc expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.508098:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c200/0xd5b980e0d62afae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afadc expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.508105:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c200/0xd5b980e0d62afae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afadc expref: 17 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.508111:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c200, rc 0) 00000100:00100000:3.0:1789892695.508147:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055590912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 79us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.508155:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2548 00000100:00100000:1.0:1789892695.508186:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055590912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.508203:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afae3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.508214:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afae3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.508253:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.508277:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.508296:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.508312:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591040 00000100:00100000:2.0:1789892695.508316:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591040 00000100:00100000:2.0:1789892695.508342:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2549 00000100:00100000:2.0:1789892695.508352:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055591040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.508433:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030850dd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055591040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 83us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.508441:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2549 00000100:00100000:1.0:1789892695.508466:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.508495:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.508521:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.508536:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.508561:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591168 00000100:00100000:0.0:1789892695.508566:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591168 00000100:00100000:0.0:1789892695.508597:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2550 00000100:00100000:0.0:1789892695.508605:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055591168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.508698:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055591168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892695.508705:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.508706:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2550 00000040:00080000:3.0:1789892695.509389:0:218697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 64768 count 41 00000020:01000000:1.0:1789892695.509458:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 41-40 (rc=0) 10000000:01000000:1.0:1789892695.509475:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1789892695.509481:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afae3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.509490:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7a00/0xd5b980e0d62afadc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afae3 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.509500:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892695.509502:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f48b800 from 193 10000000:01000000:1.0:1789892695.509504:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892695.509516:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.509521:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.509527:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.509535:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591296:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.509555:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.509573:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.509591:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591296 00000100:00100000:0.0:1789892695.509595:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591296 00000100:00100000:0.0:1789892695.509616:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2551 00000100:00100000:0.0:1789892695.509620:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+17:190667:x1876835055591296:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892695.509626:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892695.509633:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afaf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afaea expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.509647:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afaea expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.509654:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99e00/0xd5b980e0d62afaf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afaea expref: 18 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.509660:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99e00, rc 0) 00000100:00100000:0.0:1789892695.509710:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055591296:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.509716:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2551 00000100:00100000:1.0:1789892695.509728:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591296:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.509747:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaf1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.509754:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afaf1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.509780:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.509800:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.509832:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.509840:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591424 00000100:00100000:3.0:1789892695.509845:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591424 00000100:00100000:3.0:1789892695.509872:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2552 00000100:00100000:3.0:1789892695.509879:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055591424:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.509945:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055591424:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.509952:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2552 00000100:00100000:1.0:1789892695.509963:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591424:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.509986:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.510018:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.510032:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.510057:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591552 00000100:00100000:2.0:1789892695.510062:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591552 00000100:00100000:2.0:1789892695.510094:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2553 00000100:00100000:2.0:1789892695.510104:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055591552:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.510180:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055591552:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 76us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.510190:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2553 00000100:00100000:1.0:1789892695.510194:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591552:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.510405:0:218698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218698:1876835055591680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.510436:0:218698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.510450:0:218698:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.510468:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591680 00000100:00100000:0.0:1789892695.510480:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591680 00000100:00100000:0.0:1789892695.510519:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2554 00000100:00100000:0.0:1789892695.510528:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218698:x1876835055591680:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.510601:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218698:x1876835055591680:12345-0@lo:502:llog_process_th.0 Request processed in 75us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.510607:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2554 00000100:00100000:2.0:1789892695.510626:0:218698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218698:1876835055591680:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.510658:0:218698:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218698:1876835055591808:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.510706:0:218698:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892695.510737:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591808 00000100:00100000:2.0:1789892695.510738:0:218698:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.510742:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591808 00000100:00100000:0.0:1789892695.510767:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2555 00000100:00100000:0.0:1789892695.510774:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218698:x1876835055591808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.510851:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:218698:x1876835055591808:12345-0@lo:502:llog_process_th.0 Request processed in 77us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.510860:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2555 00000100:00100000:2.0:1789892695.510866:0:218698:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218698:1876835055591808:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789892695.510889:0:218698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:1.0:1789892695.510942:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:1.0:1789892695.510957:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892695.510962:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaf1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.510968:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6200/0xd5b980e0d62afaea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaf1 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.510973:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1789892695.510975:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 44 10000000:01000000:1.0:1789892695.510976:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892695.510988:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.511002:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.511008:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.511016:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591936:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.511038:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.511054:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.511072:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055591936 00000100:00100000:3.0:1789892695.511077:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055591936 00000100:00100000:3.0:1789892695.511102:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2556 00000100:00100000:3.0:1789892695.511109:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+18:190667:x1876835055591936:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892695.511117:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892695.511126:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d200/0xd5b980e0d62afaff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afaf8 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.511152:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d200/0xd5b980e0d62afaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afaf8 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.511162:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d200/0xd5b980e0d62afaff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afaf8 expref: 19 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.511170:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d200, rc 0) 00000100:00100000:3.0:1789892695.511200:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055591936:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 91us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.511208:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2556 00000100:00100000:1.0:1789892695.511231:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055591936:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.511243:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaff expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.511252:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afaff expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.511281:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.511299:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.511312:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.511329:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592064 00000100:00100000:2.0:1789892695.511333:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592064 00000100:00100000:2.0:1789892695.511356:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2557 00000100:00100000:2.0:1789892695.511361:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055592064:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.511421:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055592064:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 59us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.511427:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2557 00000100:00100000:1.0:1789892695.511442:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592064:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.511460:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.511486:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.511499:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.511515:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592192 00000100:00100000:0.0:1789892695.511519:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592192 00000100:00100000:0.0:1789892695.511545:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2558 00000100:00100000:0.0:1789892695.511552:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055592192:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.511637:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055592192:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 83us (147us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892695.511647:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592192:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.511647:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2558 00000040:00080000:0.0:1789892695.512461:0:218699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 64768 count 44 00000020:01000000:1.0:1789892695.512559:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 44-43 (rc=0) 10000000:01000000:1.0:1789892695.512578:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789892695.512583:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaff expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.512590:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6400/0xd5b980e0d62afaf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afaff expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.512597:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892695.512599:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff903081d68000 from 193 10000000:01000000:1.0:1789892695.512600:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892695.512613:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.512618:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.512624:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.512633:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.512656:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892695.512696:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592320 00000100:00100000:0.0:1789892695.512700:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592320 00000100:00100000:1.0:1789892695.512708:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.512729:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2559 00000100:00100000:0.0:1789892695.512737:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+19:190667:x1876835055592320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892695.512743:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892695.512755:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99000/0xd5b980e0d62afb0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afb06 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.512768:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99000/0xd5b980e0d62afb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afb06 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.512775:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99000/0xd5b980e0d62afb0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afb06 expref: 20 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.512780:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99000, rc 0) 00000100:00100000:0.0:1789892695.512807:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030938f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055592320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 72us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.512812:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2559 00000100:00100000:1.0:1789892695.512842:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.512853:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb0d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.512859:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afb0d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.512886:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.512913:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.512935:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.512948:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592448 00000100:00100000:3.0:1789892695.512953:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592448 00000100:00100000:3.0:1789892695.512979:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2560 00000100:00100000:3.0:1789892695.512987:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055592448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.513060:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055592448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.513068:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2560 00000100:00100000:1.0:1789892695.513088:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.513111:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.513142:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.513158:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452c840 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.513182:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592576 00000100:00100000:2.0:1789892695.513186:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592576 00000100:00100000:2.0:1789892695.513210:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2561 00000100:00100000:2.0:1789892695.513216:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055592576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.513276:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ef050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055592576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.513283:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2561 00000100:00100000:1.0:1789892695.513304:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.513462:0:218700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218700:1876835055592704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892695.513490:0:218700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.513503:0:218700:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.513527:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592704 00000100:00100000:0.0:1789892695.513533:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592704 00000100:00100000:0.0:1789892695.513566:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2562 00000100:00100000:0.0:1789892695.513574:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218700:x1876835055592704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.513657:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218700:x1876835055592704:12345-0@lo:502:llog_process_th.0 Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.513666:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2562 00000100:00100000:1.0:1789892695.513668:0:218700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218700:1876835055592704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892695.513736:0:218700:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218700:1876835055592832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789892695.513767:0:218700:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.513789:0:218700:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.513792:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592832 00000100:00100000:0.0:1789892695.513798:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592832 00000100:00100000:0.0:1789892695.513841:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2563 00000100:00100000:0.0:1789892695.513850:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218700:x1876835055592832:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.513915:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ec450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:218700:x1876835055592832:12345-0@lo:502:llog_process_th.0 Request processed in 67us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.513922:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2563 00000100:00100000:1.0:1789892695.513936:0:218700:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218700:1876835055592832:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789892695.513957:0:218700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:2.0:1789892695.514004:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:2.0:1789892695.514027:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789892695.514034:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb0d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.514044:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6600/0xd5b980e0d62afb06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb0d expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789892695.514053:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:2.0:1789892695.514055:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 221 10000000:01000000:2.0:1789892695.514058:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:2.0:1789892695.514083:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.514092:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.514101:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892695.514116:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.514140:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.514155:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.514178:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055592960 00000100:00100000:3.0:1789892695.514184:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055592960 00000100:00100000:3.0:1789892695.514212:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2564 00000100:00100000:3.0:1789892695.514217:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+20:190667:x1876835055592960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892695.514223:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892695.514230:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9d000/0xd5b980e0d62afb1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afb14 expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.514242:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9d000/0xd5b980e0d62afb1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afb14 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.514254:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9d000/0xd5b980e0d62afb1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afb14 expref: 21 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.514267:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9d000, rc 0) 00000100:00100000:3.0:1789892695.514295:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854efc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055592960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 78us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.514301:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2564 00000100:00100000:2.0:1789892695.514321:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055592960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892695.514331:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb1b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.514337:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afb1b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789892695.514368:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.514388:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.514401:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.514418:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593088 00000100:00100000:0.0:1789892695.514431:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593088 00000100:00100000:0.0:1789892695.514466:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2565 00000100:00100000:0.0:1789892695.514477:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055593088:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.514540:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ee050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055593088:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 67us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.514546:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2565 00000100:00100000:2.0:1789892695.514557:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593088:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.514580:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.514609:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.514622:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.514628:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593216 00000100:00100000:0.0:1789892695.514632:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593216 00000100:00100000:0.0:1789892695.514653:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2566 00000100:00100000:0.0:1789892695.514658:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055593216:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.514743:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055593216:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (133us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.514749:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2566 00000100:00100000:2.0:1789892695.514761:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593216:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.514943:0:218701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218701:1876835055593344:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.514979:0:218701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.514999:0:218701:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.515011:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593344 00000100:00100000:0.0:1789892695.515015:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593344 00000100:00100000:0.0:1789892695.515038:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2567 00000100:00100000:0.0:1789892695.515044:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218701:x1876835055593344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.515118:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9030854edc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218701:x1876835055593344:12345-0@lo:502:llog_process_th.0 Request processed in 73us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.515124:0:218701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218701:1876835055593344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.515125:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2567 00000020:01000000:2.0:1789892695.515153:0:218701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892695.515164:0:218701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892695.515167:0:218701:0:(obd_config.c:1561:class_process_config()) marker 210 (0x1) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892695.515171:0:218701:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789892695.515190:0:218701:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 1 00000100:00100000:2.0:1789892695.515203:0:218701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218701:1876835055593472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.515229:0:218701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.515243:0:218701:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.515258:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593472 00000100:00100000:3.0:1789892695.515263:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593472 00000100:00100000:3.0:1789892695.515284:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2568 00000100:00100000:3.0:1789892695.515289:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218701:x1876835055593472:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.515353:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218701:x1876835055593472:12345-0@lo:502:llog_process_th.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.515359:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2568 00000100:00100000:2.0:1789892695.515377:0:218701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218701:1876835055593472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.515406:0:218701:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218701:1876835055593600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.515430:0:218701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892695.515443:0:218701:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.515455:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593600 00000100:00100000:0.0:1789892695.515461:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593600 00000100:00100000:0.0:1789892695.515488:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2569 00000100:00100000:0.0:1789892695.515494:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218701:x1876835055593600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.515548:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:218701:x1876835055593600:12345-0@lo:502:llog_process_th.0 Request processed in 55us (116us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.515561:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2569 00000100:00100000:2.0:1789892695.515567:0:218701:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218701:1876835055593600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892695.515592:0:218701:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789892695.515595:0:218701:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892695.515597:0:218701:0:(obd_config.c:1561:class_process_config()) marker 210 (0x2) lustre-MDT0001-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:2.0:1789892695.515599:0:218701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 225 count 220 00000020:01000000:1.0:1789892695.515649:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 221-224 (rc=0) 10000000:01000000:1.0:1789892695.515669:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1789892695.515674:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb1b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.515706:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff90319d382400/0xd5b980e0d62afb14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb1b expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.515728:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789892695.515730:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff90319f488800 from 193 10000000:01000000:1.0:1789892695.515732:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789892695.515747:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.515753:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.515758:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.515767:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.515787:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892695.515810:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593728 00000100:00100000:1.0:1789892695.515811:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.515815:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593728 00000100:00100000:0.0:1789892695.515852:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2570 00000100:00100000:0.0:1789892695.515857:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+21:190667:x1876835055593728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892695.515862:0:190664:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892695.515869:0:190664:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e99200/0xd5b980e0d62afb29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afb22 expref: -99 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.515882:0:190664:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e99200/0xd5b980e0d62afb29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afb22 expref: 22 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.515888:0:190664:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e99200/0xd5b980e0d62afb29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afb22 expref: 22 pid: 190664 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.515893:0:190664:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e99200, rc 0) 00000100:00100000:0.0:1789892695.515919:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055593728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 61us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.515924:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2570 00000100:00100000:1.0:1789892695.515932:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.515945:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb29 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.515951:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afb29 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.515981:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.516001:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.516015:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.516031:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593856 00000100:00100000:2.0:1789892695.516035:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593856 00000100:00100000:2.0:1789892695.516059:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2571 00000100:00100000:2.0:1789892695.516064:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055593856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.516130:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055593856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (127us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.516136:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2571 00000100:00100000:1.0:1789892695.516156:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.516185:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.516215:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.516232:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.516249:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055593984 00000100:00100000:3.0:1789892695.516254:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055593984 00000100:00100000:3.0:1789892695.516285:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2572 00000100:00100000:3.0:1789892695.516292:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055593984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.516358:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055593984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.516365:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2572 00000100:00100000:1.0:1789892695.516370:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055593984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.516561:0:218702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218702:1876835055594112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.516595:0:218702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892695.516612:0:218702:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cb516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.516629:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594112 00000100:00100000:0.0:1789892695.516635:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594112 00000100:00100000:0.0:1789892695.516664:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2573 00000100:00100000:0.0:1789892695.516672:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218702:x1876835055594112:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.516786:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218702:x1876835055594112:12345-0@lo:502:llog_process_th.0 Request processed in 115us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.516797:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2573 00000100:00100000:3.0:1789892695.516804:0:218702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218702:1876835055594112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.516860:0:218702:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218702:1876835055594240:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.516893:0:218702:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892695.516915:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594240 00000100:00100000:3.0:1789892695.516918:0:218702:0:(client.c:2702:ptlrpc_set_wait()) set ffff90319cb516c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.516928:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594240 00000100:00100000:0.0:1789892695.516951:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2574 00000100:00100000:0.0:1789892695.516958:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218702:x1876835055594240:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.517012:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:218702:x1876835055594240:12345-0@lo:502:llog_process_th.0 Request processed in 55us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.517019:0:218702:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218702:1876835055594240:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.517019:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2574 00000040:00080000:3.0:1789892695.517045:0:218702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 196 count 192 00000020:01000000:1.0:1789892695.517094:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 193-195 (rc=0) 10000000:01000000:1.0:1789892695.517110:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789892695.517117:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb29 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.517126:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7600/0xd5b980e0d62afb22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb29 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.517135:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1789892695.517137:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 221 10000000:01000000:1.0:1789892695.517139:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1789892695.517153:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.517161:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.517168:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.517178:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055594368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.517198:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.517212:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789892695.517226:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594368 00000100:00100000:2.0:1789892695.517230:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594368 00000100:00100000:2.0:1789892695.517253:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2575 00000100:00100000:2.0:1789892695.517259:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+22:190667:x1876835055594368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789892695.517265:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789892695.517271:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90319d383400/0xd5b980e0d62afb37 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afb30 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.517283:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90319d383400/0xd5b980e0d62afb37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afb30 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.517289:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90319d383400/0xd5b980e0d62afb37 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afb30 expref: 23 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789892695.517294:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90319d383400, rc 0) 00000100:00100000:2.0:1789892695.517321:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055594368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 64us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.517326:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2575 00000100:00100000:1.0:1789892695.517346:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055594368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.517361:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb37 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.517368:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afb37 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.517396:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055594496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.517416:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.517432:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.517450:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594496 00000100:00100000:3.0:1789892695.517455:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594496 00000100:00100000:3.0:1789892695.517482:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2576 00000100:00100000:3.0:1789892695.517489:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055594496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.517555:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055594496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 66us (136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.517563:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2576 00000100:00100000:1.0:1789892695.517569:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055594496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.517594:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055594624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.517626:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.517641:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.517650:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594624 00000100:00100000:0.0:1789892695.517655:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594624 00000100:00100000:0.0:1789892695.517676:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2577 00000100:00100000:0.0:1789892695.517727:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055594624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.517784:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055594624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 60us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.517789:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2577 00000100:00100000:1.0:1789892695.517800:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055594624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.517977:0:218703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218703:1876835055594752:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789892695.518008:0:218703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892695.518030:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594752 00000100:00100000:2.0:1789892695.518032:0:218703:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308563fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.518035:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594752 00000100:00100000:0.0:1789892695.518060:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2578 00000100:00100000:0.0:1789892695.518064:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218703:x1876835055594752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.518156:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218703:x1876835055594752:12345-0@lo:502:llog_process_th.0 Request processed in 90us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.518165:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2578 00000100:00100000:2.0:1789892695.518176:0:218703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218703:1876835055594752:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789892695.518197:0:218703:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789892695.518207:0:218703:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789892695.518208:0:218703:0:(obd_config.c:1561:class_process_config()) marker 209 (0x1) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000020:00000080:2.0:1789892695.518212:0:218703:0:(obd_config.c:1470:class_process_config()) processing cmd: ce021 00020000:01000000:2.0:1789892695.518219:0:218703:0:(lod_pool.c:594:lod_pool_add()) Added lustre-OST0001_UUID to qpool1 as member 1 00000020:01000004:2.0:1789892695.518540:0:218704:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90319f488800 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789892695.518543:0:218704:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90319f488800 4 00000100:00100000:0.0:1789892695.518550:0:218703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218703:1876835055594880:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.518597:0:218703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892695.518626:0:218703:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.518628:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055594880 00000100:00100000:3.0:1789892695.518633:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055594880 00000100:00100000:3.0:1789892695.518664:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2579 00000100:00100000:3.0:1789892695.518672:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218703:x1876835055594880:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.518773:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218703:x1876835055594880:12345-0@lo:502:llog_process_th.0 Request processed in 102us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.518783:0:218703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218703:1876835055594880:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.518784:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2579 00000100:00100000:0.0:1789892695.518839:0:218703:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218703:1876835055595008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789892695.518880:0:218703:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892695.518911:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595008 00000100:00100000:0.0:1789892695.518913:0:218703:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308213a0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789892695.518916:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595008 00000100:00100000:3.0:1789892695.518939:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2580 00000100:00100000:3.0:1789892695.518944:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218703:x1876835055595008:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.518995:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:218703:x1876835055595008:12345-0@lo:502:llog_process_th.0 Request processed in 51us (115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.519008:0:218703:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd38700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7a73bea3-52ef-4f47-91a7-526f90b17ebf:218703:1876835055595008:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789892695.519013:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2580 00000020:01000000:0.0:1789892695.519041:0:218703:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789892695.519048:0:218703:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789892695.519050:0:218703:0:(obd_config.c:1561:class_process_config()) marker 209 (0x2) lustre-MDT0000-m add lustre.qpool1.lustre-OST0001_UUID 00000040:00080000:0.0:1789892695.519056:0:218703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 225 count 220 00000020:01000000:1.0:1789892695.519112:0:190667:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 221-224 (rc=0) 10000000:01000000:1.0:1789892695.519128:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789892695.519133:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb37 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.519139:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc6a00/0xd5b980e0d62afb30 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb37 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789892695.519144:0:190667:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1789892695.519146:0:190667:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff90308337b380 from 1 10000000:01000000:1.0:1789892695.519147:0:190667:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789892695.519158:0:190667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.519172:0:190667:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.519178:0:190667:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.519187:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055595136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.519207:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.519220:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.519232:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595136 00000100:00100000:0.0:1789892695.519238:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595136 00000100:00100000:0.0:1789892695.519271:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2581 00000100:00100000:0.0:1789892695.519279:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+23:190667:x1876835055595136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789892695.519287:0:190663:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789892695.519296:0:190663:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e98800/0xd5b980e0d62afb45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xd5b980e0d62afb3e expref: -99 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.519313:0:190663:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e98800/0xd5b980e0d62afb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd5b980e0d62afb3e expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.519322:0:190663:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e98800/0xd5b980e0d62afb45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd5b980e0d62afb3e expref: 24 pid: 190663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789892695.519329:0:190663:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e98800, rc 0) 00000100:00100000:0.0:1789892695.519366:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903088ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055595136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892695.519374:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2581 00000100:00100000:1.0:1789892695.519385:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055595136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789892695.519396:0:190667:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb45 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.519403:0:190667:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xd5b980e0d62afb45 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789892695.519429:0:190667:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055595264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789892695.519447:0:190667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892695.519460:0:190667:0:(client.c:2702:ptlrpc_set_wait()) set ffff90308452cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892695.519470:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595264 00000100:00100000:0.0:1789892695.519476:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595264 00000100:00100000:0.0:1789892695.519502:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2582 00000100:00100000:0.0:1789892695.519518:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055595264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789892695.519582:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90318ae75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:190667:x1876835055595264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 65us (132us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789892695.519591:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2582 00000100:00100000:1.0:1789892695.519595:0:190667:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7a73bea3-52ef-4f47-91a7-526f90b17ebf:190667:1876835055595264:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1789892695.519617:0:190667:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.153@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1789892695.519621:0:190667:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb45 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789892695.519627:0:190667:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.153@tcp lock: ffff903090bc7c00/0xd5b980e0d62afb3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xd5b980e0d62afb45 expref: -99 pid: 190667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789892695.675812:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892695.675894:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755456 00000100:00100000:3.0:1789892695.675908:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755456 00000100:00100000:3.0:1789892695.675983:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2583 00000100:00100000:3.0:1789892695.675998:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+8:193257:x1876835062755456:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892695.676020:0:194990:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892695.676044:0:194990:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62afb4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a260478 expref: -99 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.676082:0:194990:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62afb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260478 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.676097:0:194990:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9cc00/0xd5b980e0d62afb4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a260478 expref: 9 pid: 194990 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.676108:0:194990:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9cc00, rc 0) 00000100:00100000:3.0:1789892695.676187:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062755456:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 193us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.676196:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2583 00000100:00100000:2.0:1789892695.677165:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892695.677209:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755584 00000100:00100000:3.0:1789892695.677215:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755584 00000100:00100000:3.0:1789892695.677247:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2584 00000100:00100000:3.0:1789892695.677255:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062755584:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789892695.677413:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062755584:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 158us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.677422:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2584 00000100:00100000:0.0:1789892695.678236:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892695.678312:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755712 00000100:00100000:2.0:1789892695.678317:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755712 00000100:00100000:2.0:1789892695.678350:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2585 00000100:00100000:2.0:1789892695.678357:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062755712:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.678445:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062755712:12345-192.168.203.53@tcp:503:ll_cfg_requeue.0 Request processed in 89us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892695.678451:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2585 00000100:00100000:0.0:1789892695.679739:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892695.679787:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755840 00000100:00100000:3.0:1789892695.679793:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755840 00000100:00100000:3.0:1789892695.679881:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2586 00000100:00100000:3.0:1789892695.679890:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217254:x1876835062755840:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892695.680001:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217254:x1876835062755840:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 111us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.680009:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2586 00000100:00100000:0.0:1789892695.680788:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892695.680846:0:194990:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062755968 00000100:00100000:3.0:1789892695.680851:0:194990:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062755968 00000100:00100000:3.0:1789892695.680886:0:194990:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2587 00000100:00100000:3.0:1789892695.680894:0:194990:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217254:x1876835062755968:12345-192.168.203.53@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789892695.680963:0:194990:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0003:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:217254:x1876835062755968:12345-192.168.203.53@tcp:502:llog_process_th.0 Request processed in 68us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.680972:0:194990:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2587 00000100:00100000:0.0:1789892695.682064:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892695.682155:0:190662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062756096 00000100:00100000:3.0:1789892695.682160:0:190662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062756096 00000100:00100000:3.0:1789892695.682191:0:190662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2588 00000100:00100000:3.0:1789892695.682199:0:190662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+9:193257:x1876835062756096:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789892695.682207:0:190662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789892695.682218:0:190662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff903084e9c600/0xd5b980e0d62afb53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xacfb61ea4a26047f expref: -99 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.682235:0:190662:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff903084e9c600/0xd5b980e0d62afb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26047f expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.682246:0:190662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff903084e9c600/0xd5b980e0d62afb53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.53@tcp remote: 0xacfb61ea4a26047f expref: 10 pid: 190662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789892695.682266:0:190662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff903084e9c600, rc 0) 00000100:00100000:3.0:1789892695.682296:0:190662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062756096:12345-192.168.203.53@tcp:101:ll_cfg_requeue.0 Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892695.682306:0:190662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2588 00000100:00100000:0.0:1789892695.683144:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892695.683219:0:190663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062756224 00000100:00100000:2.0:1789892695.683226:0:190663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062756224 00000100:00100000:2.0:1789892695.683259:0:190663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2589 00000100:00100000:2.0:1789892695.683266:0:190663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062756224:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789892695.683327:0:190663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4eaca0ed-6aba-4fcf-a0cc-18a154e45401+10:193257:x1876835062756224:12345-192.168.203.53@tcp:501:ll_cfg_requeue.0 Request processed in 62us (183us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789892695.683334:0:190663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2589 00010000:00010000:2.0:1789892696.145779:0:200331:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892696.248572:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:3.0:1789892696.248626:0:192563:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062756352 00000100:00100000:3.0:1789892696.248637:0:192563:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062756352 00000100:00080000:0.0:1789892696.248719:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789892696.248769:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2818 00000100:00100000:3.0:1789892696.248826:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217274:x1876835062756352:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:0.0:1789892696.250226:0:192563:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:192563:1876835055595392:0@lo:19:mdt00_004.0 00000100:00100000:0.0:1789892696.250288:0:192563:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892696.250317:0:192563:0:(client.c:2702:ptlrpc_set_wait()) set ffff903191d30e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789892696.250339:0:192562:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595392 00000100:00100000:0.0:1789892696.250344:0:192562:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595392 00000100:00100000:0.0:1789892696.250399:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789892696.250406:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:192563:x1876835055595392:12345-0@lo:19:mdt00_004.0 00000100:00100000:0.0:1789892696.250582:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:192563:x1876835055595392:12345-0@lo:19:mdt00_004.0 Request processed in 176us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892696.250589:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789892696.250622:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789892696.250767:0:192563:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd38380 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:192563:1876835055595392:0@lo:19:mdt00_004.0 00000100:00100000:0.0:1789892696.250849:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217274:x1876835062756352:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2052us (2284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892696.250864:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2818 00000100:00100000:0.0:1789892696.251928:0:3612:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892696.251967:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062756480 00000100:00100000:2.0:1789892696.251973:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062756480 00000100:00100000:2.0:1789892696.252010:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2819 00000100:00100000:2.0:1789892696.252018:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217274:x1876835062756480:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:2.0:1789892696.254265:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217274:x1876835062756480:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 2246us (2335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892696.254290:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2819 00000004:00080000:0.0:1789892697.088628:0:218853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 3387342946802ns, next at 3261060696520ns, rc = 0 00080000:00080000:0.0:1789892697.088643:0:218853:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892697.088755:0:218853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 3387343075442ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892697.088761:0:218853:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1789892697.088854:0:218853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 3387343173345ns, next at 3187969760152ns, rc = 0 00080000:00080000:0.0:1789892697.088861:0:218853:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1789892697.088917:0:218853:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 3387343237895ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789892697.088922:0:218853:0:(osd_handler.c:2850:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:3.0:1789892697.089305:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 46 committed 00000004:00080000:1.0:1789892697.089314:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 38 committed 00000004:00080000:1.0:1789892697.089839:0:191400:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 38 committed 00000004:00080000:3.0:1789892697.089845:0:190650:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 44 committed 00000100:00100000:2.0:1789892697.105784:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055595520:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789892697.105863:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892697.105905:0:190674:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595520 00000100:00100000:0.0:1789892697.105913:0:190674:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595520 00000100:00100000:0.0:1789892697.105960:0:190674:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1789892697.105971:0:190674:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055595520:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789892697.106001:0:190674:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789892697.106094:0:190674:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089fe9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055595520:12345-0@lo:41:osp-pre-1-0.0 Request processed in 126us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892697.106099:0:190674:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789892697.106152:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089feb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055595520:0@lo:41:osp-pre-1-0.0 00010000:00010000:2.0:1789892697.169783:0:200332:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789892697.511004:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:2.0:1789892697.511045:0:190670:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062756608 00000100:00100000:2.0:1789892697.511055:0:190670:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062756608 00000100:00100000:2.0:1789892697.511103:0:190670:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2820 00000100:00100000:2.0:1789892697.511113:0:190670:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217464:x1876835062756608:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:2.0:1789892697.511205:0:190670:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217464:x1876835062756608:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 94us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789892697.511211:0:190670:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2820 00000100:00100000:0.0:1789892697.519705:0:3611:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.53@tcp (source: 12345-192.168.203.53@tcp) 00000100:00100000:1.0:1789892697.519756:0:190671:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835062756736 00000100:00100000:1.0:1789892697.519763:0:190671:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835062756736 00000100:00100000:1.0:1789892697.519818:0:190671:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.53@tcp, seq: 2821 00000100:00100000:1.0:1789892697.519829:0:190671:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217466:x1876835062756736:12345-192.168.203.53@tcp:48:lfs.0 00000100:00100000:1.0:1789892697.519896:0:190671:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3400b0a6-c22f-4041-a424-3221ecd8e600+6:217466:x1876835062756736:12345-192.168.203.53@tcp:48:lfs.0 Request processed in 70us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.519903:0:190671:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.53@tcp, seq: 2821 00000100:00100000:1.0:1789892697.617868:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055595648:0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.617869:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903089fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055595904:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789892697.617888:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055595776:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789892697.617946:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055596160:0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.617962:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892697.617969:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892697.617979:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892697.618011:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789892697.618023:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055596032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789892697.618025:0:3619:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90319cd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055596288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789892697.618030:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055596416:0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.618041:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055596544:0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.618062:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892697.618080:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892697.618086:0:190664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595648 00000100:00100000:3.0:1789892697.618088:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892697.618093:0:190664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595648 00000100:00100000:1.0:1789892697.618100:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055596672:0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618117:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055596928:0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.618128:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892697.618135:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055597056:0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.618155:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055597184:0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618162:0:190664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1789892697.618165:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892697.618178:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892697.618193:0:190664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055595648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618200:0:3620:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055597440:0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.618211:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892697.618218:0:3621:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055597568:0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618249:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595904 00000100:00100000:2.0:1789892697.618255:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595904 00000100:00100000:3.0:1789892697.618260:0:3621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789892697.618272:0:190664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319efc4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7a73bea3-52ef-4f47-91a7-526f90b17ebf+24:3618:x1876835055595648:12345-0@lo:400:kworker.0 Request processed in 82us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.618278:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7a73bea3-52ef-4f47-91a7-526f90b17ebf:3618:1876835055595648:0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618285:0:190664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2590 00000100:00100000:2.0:1789892697.618303:0:190693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596672 00000100:00100000:2.0:1789892697.618309:0:190693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596672 00000100:00100000:1.0:1789892697.618311:0:3618:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789892697.618312:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055595776 00000100:00100000:3.0:1789892697.618319:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055595776 00000100:00100000:1.0:1789892697.618321:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055596800:0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618335:0:3619:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892697.618341:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789892697.618350:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789892697.618356:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055595904:12345-0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789892697.618363:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596032 00000100:00100000:3.0:1789892697.618369:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596032 00000100:00100000:1.0:1789892697.618376:0:3618:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876835055597312:0@lo:400:kworker.0 00000100:00080000:0.0:1789892697.618377:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789892697.618388:0:197050:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596288 00000100:00100000:0.0:1789892697.618393:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1789892697.618400:0:3618:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789892697.618401:0:197050:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596288 00000100:00100000:0.0:1789892697.618404:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055595776:12345-0@lo:13:osp-pre-1-1.0 00000004:00000024:2.0:1789892697.618406:0:190693:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 484638720 pending 0 free 1445842944 avail 1299603456 00000100:00100000:3.0:1789892697.618432:0:197050:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00002000:00000024:0.0:1789892697.618432:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1789892697.618442:0:197050:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055596032:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789892697.618445:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596544 00000100:00100000:1.0:1789892697.618450:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596544 00002000:00000024:3.0:1789892697.618454:0:197050:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892697.618484:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055597056 00000100:00100000:1.0:1789892697.618489:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055597056 00000100:00100000:2.0:1789892697.618490:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089feaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+6:3620:x1876835055595904:12345-0@lo:41:osp-pre-0-1.0 Request processed in 138us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892697.618497:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055595776:12345-0@lo:13:osp-pre-1-1.0 Request processed in 93us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618500:0:197050:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ce9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3618:x1876835055596032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.618503:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055597184 00000100:00100000:1.0:1789892697.618508:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055597184 00000100:00100000:2.0:1789892697.618511:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1789892697.618516:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789892697.618522:0:197050:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1789892697.618529:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055597568 00000100:00100000:1.0:1789892697.618533:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055597568 00000100:00100000:2.0:1789892697.618544:0:190693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789892697.618547:0:192180:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789892697.618551:0:192197:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055597312 00000100:00100000:1.0:1789892697.618554:0:192197:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055597312 00000100:00100000:2.0:1789892697.618560:0:190693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055596672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618561:0:192180:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90319cd39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055596288:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789892697.618575:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596160 00000100:00100000:1.0:1789892697.618577:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 527 00000100:00100000:3.0:1789892697.618582:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596160 00002000:00000024:0.0:1789892697.618587:0:192180:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1789892697.618589:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055596544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618617:0:190693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087cea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055596672:12345-0@lo:400:kworker.0 Request processed in 61us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618621:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596416 00000100:00100000:3.0:1789892697.618627:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596416 00000100:00100000:2.0:1789892697.618628:0:190693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1789892697.618638:0:192180:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90319cd39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3619:x1876835055596288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.618648:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+11:3621:x1876835055596544:12345-0@lo:400:kworker.0 Request processed in 61us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892697.618649:0:192180:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1789892697.618653:0:192175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596928 00000100:00100000:3.0:1789892697.618658:0:192175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596928 00000100:00100000:1.0:1789892697.618663:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 527 00000100:00100000:2.0:1789892697.618671:0:193164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055596800 00000100:00100000:3.0:1789892697.618707:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789892697.618707:0:193164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055596800 00000100:00100000:1.0:1789892697.618712:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1789892697.618718:0:192562:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789892697.618723:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055596160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.618725:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876835055597056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618732:0:192562:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089fea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055596416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618744:0:193164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789892697.618758:0:193164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903089fead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055596928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.618779:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3621:x1876835055596160:12345-0@lo:400:kworker.0 Request processed in 60us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.618787:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+11:3621:x1876835055597056:12345-0@lo:400:kworker.0 Request processed in 67us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618789:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1789892697.618793:0:192562:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089fea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3620:x1876835055596416:12345-0@lo:400:kworker.0 Request processed in 65us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.618818:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 528 00000100:00100000:0.0:1789892697.618822:0:192562:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1789892697.618829:0:192175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789892697.618836:0:193164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903089fead80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3620:x1876835055596928:12345-0@lo:400:kworker.0 Request processed in 79us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618845:0:192175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055596800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.618847:0:192197:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1789892697.618855:0:193164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1789892697.618861:0:192563:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 530 00000100:00100000:1.0:1789892697.618862:0:192197:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055597184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618879:0:192563:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055597568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.618891:0:192175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087ce9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3618:x1876835055596800:12345-0@lo:400:kworker.0 Request processed in 53us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618899:0:192175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1789892697.618904:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789892697.618910:0:192197:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087cead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+8:3618:x1876835055597184:12345-0@lo:400:kworker.0 Request processed in 52us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1789892697.618916:0:192197:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 529 00000100:00100000:2.0:1789892697.618922:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff903087cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876835055597312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618942:0:192563:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903184bda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3621:x1876835055597568:12345-0@lo:400:kworker.0 Request processed in 66us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618950:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3621:1876835055596160:0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.618950:0:192563:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 530 00000100:00080000:1.0:1789892697.618954:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1789892697.618961:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789892697.618966:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789892697.618968:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3621:1876835055596544:0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618979:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff903087cea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3618:x1876835055597312:12345-0@lo:400:kworker.0 Request processed in 61us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789892697.618989:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3621:1876835055597056:0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.618989:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 531 00000100:00100000:1.0:1789892697.619008:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055595776:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789892697.619010:0:3620:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789892697.619024:0:3621:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff903184bdb100 x1876835055597568/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892697.619028:0:190669:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876835055597440 00000100:00100000:2.0:1789892697.619034:0:190669:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876835055597440 00000100:00100000:3.0:1789892697.619043:0:3621:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bdb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3621:1876835055597568:0@lo:400:kworker.0 00000100:00100000:1.0:1789892697.619044:0:3619:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90319cd3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3619:1876835055596288:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789892697.619052:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903089fe8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055595904:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789892697.619078:0:190669:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 532 00000100:00100000:0.0:1789892697.619086:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3620:1876835055596416:0@lo:400:kworker.0 00000100:00080000:1.0:1789892697.619088:0:190665:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789892697.619091:0:190669:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff90309fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055597440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789892697.619111:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3620:1876835055596928:0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.619114:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055596800:0@lo:400:kworker.0 00010000:00080000:3.0:1789892697.619133:0:3618:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90309260f480 x1876835055597312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789892713 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789892697.619139:0:190669:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff90309fd84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+8:3620:x1876835055597440:12345-0@lo:400:kworker.0 Request processed in 50us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789892697.619144:0:3620:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903184bd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3620:1876835055597440:0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.619145:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3618:1876835055597312:0@lo:400:kworker.0 00000100:00100000:2.0:1789892697.619159:0:190669:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 532 00000100:00100000:3.0:1789892697.619163:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3618:1876835055596672:0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.619178:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff90309260f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3618:1876835055597184:0@lo:400:kworker.0 00000100:00100000:3.0:1789892697.619194:0:3618:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff903087cebb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3618:1876835055596032:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789892697.990531:0:218949:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-quota test_72: @@@@@@ FAIL: Used space(10240) for user quota_usr isn't 0. 00010000:00010000:1.0:1789892698.193894:0:190659:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 10394 lines, 10394 kept, 0 dropped, 0 bad.